Towards a Fully Adjusted Census Database for the 2011 Census

Slides:



Advertisements
Similar presentations
Measuring Coverage: Post Enumeration Surveys Owen Abbott Office for National Statistics, UK.
Advertisements

Quality assurance -Population and Housing Census Alma Kondi, INSTAT, Albania.
Weighting and Imputation for CORE Social Housing Statistics Julia Bowman & Niall Goulding.
1 The 2010 Census Coverage Measurement Survey Patrick J. Cantwell U.S Census Bureau Annual Meeting of the Association of Public Data Users September 25,
Combining administrative and survey data: potential benefits and impact on editing and imputation for a structural business survey UNECE Work Session on.
Copyright 2010, The World Bank Group. All Rights Reserved. Estimation and Weighting, Part I.
Coverage assessment and adjustment methodology Owen Abbott Methodology Directorate, ONS.
2011 CENSUS Coverage Assessment – What’s new? OWEN ABBOTT.
Methodology for producing the revised back series of population estimates for Julie Jefferies Population and Demography Division Office for.
1 Measuring Uncertainty in Population Estimates at Local Authority Level Ruth Fulton, Bex Newell, Dorothee Schneider.
Imputation in the 2001 Census Robert Beatty NILS User Forum 11 December 2009.
Quality Assurance Programme of the Canadian Census of Population Expert Group Meeting on Population and Housing Censuses Geneva July 7-9, 2010.
Design of the 2011 Census Coverage Survey Owen Abbott (ONS) James Brown (Institute of Education)
United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23.
Targeting of Public Spending Menno Pradhan Senior Poverty Economist The World Bank office, Jakarta.
2011 Census Data Quality Assurance Strategy: Plans and developments for the 2009 Rehearsal and 2011 Census Paula Guy BSPS 10 th September 2009.
Exploring Microsimulation Methodologies for the Estimation of Household Attributes Dimitris Ballas, Graham Clarke, and Ian Turton School of Geography University.
The 2011 Census: Estimating the Population Alexa Courtney.
An Overview of Editing and Imputation Methods for the next Italian Censuses Gianpiero Bianchi, Antonia Manzari, Alessandra Reale UNECE-Eurostat Meeting.
IAOS Shanghai – Reshaping Official Statistics Some Initiatives on Combining Data to Support Small Area Statistics and Analytical Requirements at.
Evaluating imputation of sex and age for substitutes in substitute households Michael Ryan 2008 UNECE Work Session on Statistical Data Editing.
Numeracy & Quantitative Methods Laura Lake. A census: - collecting information from each and every person of interest. A sample: - when the population.
Weighting and imputation PHC 6716 July 13, 2011 Chris McCarty.
PHIA Surveys: Sample Designs and Estimation Procedures Graham Kalton Westat.
Methods for Data-Integration
Quality Assurance in Population and Housing Censuses
Senior Consultant, The Annie E. Casey Foundation
Demographic Analysis Migration: Estimation Using Residual Methods -
Evaluating the potential for moving away from a traditional census Becky Tinsley Office for National Statistics (ONS), UK.
Agenda Introduction Why have a PES? Essential features of a PES
Quality assurance in population and housing census SUDAN’s EXPERIANCE in QUALITY assurance of Censuses By salah El din. A . Magid OUR EXPERIANCE IN 5.
Workshop on Demographic Analysis
Social Research Methods
Use of Administrative Data for Census 2021
Improved Method for the Geographical Distribution of Out-Migrants
Märt Möls, Krista Fischer, Anneli Uusküla, Helle Kilgi
2011 Census The First Results
The cost of smoking in England: data from the Smoking Toolkit Study
Assessing Disclosure Risk in Microdata
Selection bias and auditing policies on insurance claims
Integrating administrative data – the 2021 Census and beyond
Some challenges for small area estimation
Obtaining information on non-responders: a development of the basic question approach for surveys of individuals Patten Smith (Ipsos MORI) Richard Harry.
What makes an effective sample survey?
Rudi Seljak, Aleš Krajnc
Data quality 1: Individual records
How to handle missing data values
Update and Overview of Administrative Records for the 2020 Census
Stratified Sampling STAT262.
Estimation methods for the integration of administrative sources
Adjusting Census Figures
Effect of Panel Length and Following Rules on Cross-Sectional Estimates of Income Distribution: Empirical Evidence from FI-SILC Marjo Pyy-Martikainen Workshop.
Post Enumeration Surveys Pres. 2
Nonresponse adjustments and calibration: a comparison between two methods to weight the Labour Force Survey Tania Borg Principal Statistician Labour Market.
Pandemic A/H1N1 influenza vaccination coverage in Montreal
LAMAS Working Group 29 June-1 July 2016
Classification Trees for Privacy in Sample Surveys
Metro ACEs Data 2018 Community Health Needs Assessment
Salah Merad Methodology Division, ONS
New Techniques and Technologies for Statistics 2017  Estimation of Response Propensities and Indicators of Representative Response Using Population-Level.
Tabulations & Dual System of Estimation (DSE)
Beyond 2011 Administrative data sources and low-level aggregate models for producing population estimates.
Treatment of Missing Data Pres. 8
Social Research Methods
A bootstrap method for estimators based on combined administrative and survey data Sander Scholtus (Statistics Netherlands) NTTS Conference 13 March 2019.
Maximising the quality of population estimates from the 2011 UK census
Tabulations & Dual System of Estimation (DSE)
Adjusting Census Figures Pres. 11
Jerome Reiter Department of Statistical Science Duke University
Workshop on best practices for EU-SILC revision, −
Presentation transcript:

Towards a Fully Adjusted Census Database for the 2011 Census Christine Sexton (ONS) Alan Taylor (ONS) James Brown (ADMIN @ IoE)

Outline Overview of the Census Coverage Assessment and Adjustment Strategy for 2011 The 2001 Adjustment Strategy Learning from 2001 Assessment of the 2001 Adjustment System The Way Forward

Census Coverage Survey Overview of the Coverage Assessment and Adjustment Process Estimation Matching Adjustment 2011 Census Quality Assurance Census Coverage Survey

The 2001 Adjustment Strategy Stage 1: Imputation of missed households (with people) Model to derive predicted census household coverage probabilities using matched census to CCS data to obtain coverage weights tenure, ethnicity, household structure Calibrate coverage weights to key variable estimates tenure exactly Impute households with people into the database whole household records copied

The 2001 Adjustment Strategy Stage 2: Imputation of missed individuals into counted households Model to derive predicted person within counted census household coverage probabilities using matched census to CCS data age, sex, activity, household structure, LA Calibrate coverage weights to key variable estimates at local authority level age-sex groups exactly Impute people into census counted households whole person records copied

The 2001 Adjustment Strategy Stage 3: Final adjustment Further adjustments to meet local authority level estimates for age-sex groups and household size distributions taking out imputed individuals putting in extra individuals (pruning and grafting) Ref: Steele, Brown and Chambers (2001), JRSS, series A.

Learning From 2001 Insufficient control of household size and characteristics for imputed households Too many people in certain age-sex groups added at household imputation stage Much time spent “pruning and grafting” Insufficient heterogeneity in the imputed population for some characteristics Whole records copied to imputed households and individuals Ensured Census edit rules satisfied but may not reflect variability in population

Assessing the Performance of the 2001 System Used simulations Uses 2001 census extracts as the ‘true population’ modelled 2001 matched census and CCS data 10 simulated censuses and CCSs for one Estimation Area (two LAs) Census coverage 94% 200,000 households 490,000 persons Used true totals as calibration constraints LA age-sex group totals, activity, tenure, household size

Performance measures

Relative Average Bias Results for Tenure

RRAMSE Results for Tenure

Relative Average Bias Results for Males by Age

RRAMSE Results for Males by Age

Relative Average Bias Results for Activity

RRAMSE Results for Activity

(pruning and grafting) The Way Forward Aim to improve imputation by gaining better control of numbers of individuals imputed into households and their characteristics Correct distribution of age group and household size at lower levels of geography Reduce time spent on final adjustment (pruning and grafting)

Modelling Missed Individuals In 2001 we modelled individuals missed within counted households no direct control of individuals missed within missed households Proposed new model – all missed individuals in single model missed within counted households missed within missed households Calibrate coverage weights for all individuals then split weights into two components based on the model

Reverse the order of imputation In 2001 household imputation carried out first Within household imputation used to make up shortfall Household weights did not match individual totals Imputed households did not contain correct types of individuals

Reverse the order of imputation New person model gives direct control over split between two sources of undercount Can put missed individuals into counted households first to complete counted households Then model census household coverage Calibrate household weights to key variables at EA level – tenure and household size Also calibrate household weights to key individual level variables from the persons in missed HHs totals – age-sex groups – at LA level to recover totals at the individual level

Conclusions By implementing the proposed changes we aim to improve on the 2001 system by gaining better control of the age-sex by household size distribution of the adjusted database and reduce the need for the final stage adjustment Analysis of 2001 method gives us a bench-mark to compare changes Work in progress

Questions? Christine.sexton@ons.gov.uk