The Census: why it matters

The UK Census is a well-established national data gathering tool, which is then used for many different analyses, but there are some gaps in what it covers. Consultation is underway on the Census 2021. The closing date for responses to the Census Consultation is Thursday 27 August.

2021 Census director, Ian Cope, says: “Information based on census data is heavily used to improve decision-making by local and central government, the health and education sectors, businesses, and by community and voluntary bodies. Of course society changes in the 10 years between each census, so we’re asking you to tell us what information you will need in 2021.

Newcastle University statistician, Tom King, explains the importance of the Census and why having your say in the topics which it surveys is vital to understanding who and what matters in society.

Census

Census 2021: Consultation

Census has a particular importance in the public engagement with our society and how it is structured. It goes to very single household, and seeks to classify aspects of our society into groups. In this way, it can shape our understanding of our own society, and what is important to our society. In many ways it is the basis for societal planning for a whole decade, as it is the only source of detailed information.

For many groups, getting a question in the census to recognise their status is of profound importance. While what is measured gets done, when something is not measured it may not be known to exist at all. Census figures form the basis of all government activity, so any further information has to come from other sources, which only more specialised groups will access. This means the consultation for census topics is always hotly contested, and many more topics are proposed than can be surveyed.

Timeline for Consultation

It may seem strange that the census is running its consultation for topics to be surveyed in 2021 six years ahead of time. But this is because it is such a huge project, often being compared to a military campaign in its scale. It also follows a rigorous testing process, so that as well as typical questionnaire development, there is also a full scale census test run two years in advance to evaluate operational processes and new questions.

Census is different to other surveys in the UK, with a statutory requirement for householders to make a census return or face a fine. The questionnaire itself is approved by parliament, another stage in the long development process.

This is not necessarily a rubber stamp, with the question on religion being introduced by parliament at this stage.

This question is framed as optional, not a caveat the statisticians were allowed, but one which was repeated in 2011.

Background to the Census

When national censuses was originally conducted, typically beginning in the 19th century, they were the only systematic source of information on a country’s population. They relied on enumerators visiting every household on census day to record their details and this process continued into the 20th century due to popular illiteracy. Census has changed, with self-completion forms and by introducing usual or ‘de jure’ residence to replace the original ‘de facto’ qualification which caused many strange anomalies.

The statistical approach has also changed and the census sits within a portfolio of detailed surveys collected by the National Statistics Office. This reflects a need for more detailed information on some issues, such as crime, and the introduction of statistical sampling of households which required a register of addresses. There are also follow up surveys to test the coverage and accuracy of the data, trying to identify who may have been missed or misclassified.

CEnsus 2

Who is included in the Census?

It is confusing to many people to describe the problem of people being missing from the census. Certainly as the number missing (around 6%) is nowhere near the number of people fined. But at 94% census has a higher response rate than any other survey, and it is the only survey to capture some population groups, such as those living in large and secure communal establishments, and the homeless. Although the overall total is totemic, it is the local geographical detail which is important.

No other source of information tells us exactly how many people live in small areas with enough detail about them e.g. their age and sex, for this to be useful for demographic models. This is why the plans to shift to administrative data on which to base census enumeration are still in development. You may believe that the government knows everything about you but the fact is they don’t, and what they do know they don’t share, even for statistical purposes.

It is often pointed out that other countries have moved to an administrative system, but their data rely on population registers, and often unique ‘social security’ or similar numbers. Britain has none of these, and in fact the census goes out without assuming anything, admitting those who are irregular, or people who would prefer not to be the part of any system at all. More than that, we collect other information on the characteristics of our population, in a detail other countries envy.

These are the topics which are so hotly contested by societal groups, while the statisticians worry themselves much more about the missing people.

Government departments, and more local relations, are the source of many questions on economic activity and education, as well as the myriad questions on ethnicity. But it is the local people who see the consequences of what it is chosen to measure and how they are to be classified, and census can only take place by popular consent, as in the community exception to the human rights act.

At present, the framing of question about activity covers attending education, working and acting as a carer for someone. This excludes a large swathe of human activity, and discounts the activity of anyone who is retired, by recording no information on any voluntary role they may have. In the particular case of transport, this means that our only detailed transport data is around commuting patterns, because it is only main mode of travel to work which is queried.

Travel and Transport: An Example

Travel planning is aimed particularly at the stress on the transport network seen in the morning rush hour, when it is closest to capacity. But anyone who actually travels to work will have noticed the difference during school holidays which cannot entirely be due to commuters being away on holiday. Similarly, university towns will notice a difference in traffic patterns during the vacations, but this portion of commuting is not collected in the census, despite its obviously localised nature.

At the heart of the transport question is one of the main reasons for having a census which has yet to be addressed.

By linking two addresses, whether as main and second homes, or within country migration, or travel to work, we see data about the flow of people around our country. A survey cannot possibly achieve this due to the small numbers seen (hence the highly uncertain figures about migration) yet this tells us a lot about our society and how we are changing.

Census 3

There are many specific topics close to many hearts for which the census is not the right source. But the census does form a direct intrusion of how our society is classified on each of us, which we should be in control of. By introducing doubt into the minds of victims of sexual assault, police were able to reduce the number of people who believed there had been a crime. Similarly, by not seeing something which is an important feature of our lives in the census questionnaire can diminish our confidence in its importance.

An example from my own experience, is the use of the travel to work data in public consultations on transport plans in Newcastle. It is widely reported that only 1.7% of people cycle in Newcastle as a reason not to accommodate cyclists in redevelopments and reallocation of the road space. But this figure is from the census and includes only those commuting by bicycle as the longest part of their journey to work: the framing is that those are the only people who matter.

Students, at school, college or university are not counted, neither are those who travel by bicycle only part of the way and it also does not consider anyone who was unemployed at that time. This is strange if there is a local school in the area where development is proposed, but is particularly flawed in the context of the money being spent. The Cycle City Ambition Fund required bids from local authorities, and all the awards were made to university towns, but there is no data on how students travel to university.

Conclusion

Not everyone is comfortable reasoning with statistics, and the census is compelling in that way as it can be viewed as a true figure rather than an estimate. Students who might like to dispute the prevalence of cycling and advocate for students for equal consideration might turn to look for data to support them, but there isn’t any.

Embracing the use of simple evidence from the census into discussions in public consultation requires the data collected to reflect our society, or those not measured will not count.

——————————————————————————————————-

Author: Tom King, is a statistician in the School of Education, Communication and Language Sciences, Newcastle University. His research interests are public statistics and inference from longitudinal social data. Thus this incorporates communicating the relevance of social measurement, typically from large datasets. He is a fellow of the Royal Statistical Society.

If you would like to contribute to a response to the Consultation from Institute for Social Renewal, please contact Fiona.Simmons@ncl.ac.uk

Freeing public service to perform

Dr Toby Lowe from the Centre for Knowledge, Innovation, Technology and Enterprise (Newcastle University Business School) presents his Idea for an Incoming Government: make public services more effective. He urges us to move away from a ‘Payment by Results’ approach, and suggests alternatives that would cope better with the messiness of the problems we face in our society.

What is the problem?

Governments have attempted to make public services more accountable for producing desirable social outcomes. From reducing reoffending to helping the long-term unemployed to find work  increasing numbers of programmes are commissioned using a ‘Payment by Results’ approach (PbR).

The rationale behind seems compelling – we should only pay for work undertaken that is effective in solving the problems that society has identified. Unfortunately, the evidence suggests that PbR creates a paradox – programmes commissioned on this basis produce worse results, particularly for those with the most complex needs.

There are two reasons why this is the case:

Firstly, real life is complex and messy. But PbR programmes need life to be simple and measurable. They require that desired ‘outcomes’ can be easily measured – because payments are triggered by these measures. Unfortunately, the complex social issues which social interventions most often deal with are frequently those that are most difficult to measure. Take, for example, tackling obesity. Body Mass Index (BMI) is the measure that is most frequently used to measure obesity.  It is used a measure of obesity because it is easy to measure: it is a simple measure of weight in proportion to height. Anyone with a BMI of more than 25 is overweight. Anyone with a BMI of more than 30 is obese.

Unfortunately, real obesity is much more complicated than that. BMI doesn’t effectively measure obesity for children, individuals with different body shapes, with different exercise regimes, and with certain medical conditions.  According to BMI measures, this woman, Anita Albrecht, who is a personal trainer, is very overweight, and is only one BMI point short of being clinically obese.

Anita Albrecht

So what happens if you use what is measurable as mechanisms to pay by results? You end up wasting time and money targeting obesity programmes on people like Anita – because that’s what simple targets, which are abstracted from the intrinsic messiness and complexity of life make people do.

The second reason that PbR makes it more difficult to create good outcomes is that they work on very simple cause and effect logic: if you are going to pay a person or organisation for producing a result, then you need to know that it was that person or that organisation which did it. How else do you know who to pay?

Unfortunately, the messiness of real life gets in the way once more. Real outcomes are emergent properties of complex systems. Look at the complex system which lies behind obesity as an issue:

Causes of obesity

This is the reality of what causes obesity. If you pay an organisation to undertake obesity activity, they can only influence a small part of this system.  Whether people actually end up obese or not is the result of the interaction of a hundred other factors.

If you pay people or organisations on the basis of whether they achieve particular results, you are asking them to be accountable for things they don’t control. As a result, they learn to manage what they can control – which is the production of data. This is the evidence about what people do:  They reclassify what counts as success (for example, counting trolleys as beds in hospitals in order to meet waiting time targets). They only work on clients who they know will provide the desired results, and they ignore the more difficult clients. They ‘teach to the test’ – only doing things which relate to what is measured, ignoring people’s needs that don’t fit into the simple measurement framework. And if all else fails, they simply make up data.

They do this because Payment by Results is nothing of the sort. Payment by Results should really be called ‘Payment for Data Production’. It changes the purpose of people’s job from helping those in need to producing the data which gets them paid.

All this is an enormous waste of resources. We end up paying huge fees to organisations who can play the data production game well, rather than those who are good at helping people. We waste resources paying organisations not to help those most in need.

The solution

The evidence is clear. If you want to achieve good outcomes, don’t pay by results. Evidence shows that these alternative approaches are successful:

1) Use systems thinking and invest in relationships. Design systems around people’s needs. Invest in organisations that build relationships with clients, and so who understand their needs authentically. Commission locally, so that the organisations have a connection with the people they serve.

2) Promote horizontal accountability. Make practitioners accountable to one another for the quality of their work. Create mechanisms for peer-based critical reflection, such as Learning Communities.

3) Create positive error cultures. Create cultures in which people talk honestly about uncertainty and mistakes – because this is how people learn and improve.