The Dutch Virtual Census of 2001 A New Approach by Combining Different Sources Eric Schulte Nordholt ECE Census meetings Geneva, 22-26 November 2004.

Slides:



Advertisements
Similar presentations
Regional Workshop for African Countries on Compilation of Basic Economic Statistics Pretoria, July 2007 Administrative Data and their Use in Economic.
Advertisements

Counting the Dutch, The Future of the Virtual Census in the Netherlands Presentation at the seminar Counting the 7 Billion 24 February 2012 * Geert Bruinooge.
EGM – Population & Housing Censuses Eurostat / UNECE - Geneva - 24/25 May 2012 Beyond 2011 The future of population statistics (England & Wales) Alistair.
Combined use of data from registers and sample surveys
The Dutch Censuses of 1960, 1971 and 2001 Producing public use files in the IPUMS project Wijnand Advokaat Statistics Netherlands Division Social and Spatial.
United Nations Workshop on Revision 3 of Principles and recommendations for Population and Housing Censuses and Census Evaluation Amman, Jordan, 19 – 23.
United Nations Expert Group Meeting on Revising the Principles and Recommendations for Population and Housing Censuses New York, 29 October – 1 November.
The Use of Administrative Sources for Economic Statistics An Overview Steven Vale Office for National Statistics UK.
UNECE Types of censuses, enumeration methods and selected operational aspects: results of the ECE questionnaire Paolo Valente Social and Demographic Statistics.
Use of administrative data in statistics - challenges and opportunities ICES III End Panel Discussion Montreal, June 2007 Heli Jeskanen-Sundström Statistics.
Joint UNECE/Eurostat Work Session on Migration Statistics 3 March, 2008, Geneva, Switzerland Selected methods to improve emigration estimates MEASURING.
Improving Quality in the Office for National Statistics’ Annual Earnings Statistics Pete Brodie & Kevin Moore UK Office for National Statistics.
United Nations Workshop on Revision 3 of Principles and recommendations for Population and Housing Censuses and Census Evaluation Amman, Jordan, 19 – 23.
1 1 Establishing a register-based statistical system Example: Population and housing censuses in Norway Statistical Training Course Use of Administrative.
GEOG3025 Census and administrative data sources 3: Integration and future development.
1 1 General preconditions Training workshop on ¨censuses using administrative registers in Geneva 21 May 2012 Harald Utne, Statistics Norway
Use of survey (LFS) to evaluate the quality of census final data Expert Group Meeting on Censuses Using Registers Geneva, May 2012 Jari Nieminen.
Dutch Virtual Census Presentation at the International Seminar on Population and Housing Censuses; Beyond the 2010 Round November, 2012 Egon Gerards,
Development of Censuses in Europe and Development for EC Statistical Co-operation European Commission (Eurostat) Jurgen Heimann UNFPA/PARIS 21 International.
Comparing approaches of different (partly) register-based countries Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics.
Using IPUMS.org Katie Genadek Minnesota Population Center University of Minnesota The IPUMS projects are funded by the National Science.
Record matching for census purposes in the Netherlands Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics Netherlands.
United Nations Sub-Regional Workshop on Census Data Evaluation Phnom Penh, Cambodia, November 2011 Evaluation of Socioeconomic Data Collected from.
Emerging methodologies for the census in the UNECE region Paolo Valente United Nations Economic Commission for Europe Statistical Division International.
Transition from traditional census to sample survey? (Experience from Population and Housing Census 2011) Group of Experts on Population and Housing Censuses,
Register-Based Census 2011 in Slovenia – Some Quality Aspects Danilo Dolenc Statistical Office of the Republic of Slovenia UNECE-Eurostat Expert Group.
1 Sources of gender statistics Angela Me UNECE Statistics Division.
United Nations Economic Commission for Europe Statistical Division Sources of gender statistics Angela Me UNECE Statistics Division.
Dominique van Roon Team socio-economic state Microdata on education level.
Population census micro data for research: the case of Slovenia Danilo Dolenc Statistical Office of the Republic of Slovenia Ljubljana, First Regional.
Copyright 2010, The World Bank Group. All Rights Reserved. Sources of Agricultural Data Section A 1.
International migration: definitions and current practices Enrico Bisogno UN Economic Commission for Europe Statistical Division.
The Dutch Virtual Census based on registers and already existing surveys Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics.
Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.
Methodology used for estimating Census tables based on incomplete information Eric Schulte Nordholt Senior researcher and project leader of the Census.
The project for developing the methodology of register- based censuses in Estonia Kristi Lehto Statistics Estonia Methodology and analysis department Senior.
New sources – administrative registers Genovefa RUŽIĆ.
Quality Assurance Programme of the Canadian Census of Population Expert Group Meeting on Population and Housing Censuses Geneva July 7-9, 2010.
CES Recommendations for 2020 round on census methodology Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics Netherlands.
Deriving labour force status in the register-based census Case of Slovenia UNECE Meeting on Censuses, Geneva, 2 October 2015 Danilo Dolenc.
WS Population Census 2004 UNECE Statistical Division METHODS USED TO COLLECT INFORMATION ON ECONOMIC CHARACTERISTICS IN THE ECE 2000 ROUND OF POPULATION.
The availability of Dutch census microdata Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics Netherlands Division Social.
Why register-based statistics? Eric Schulte Nordholt Statistics Netherlands Division Social and Spatial Statistics Department Support and Development Section.
May 12-15, Evaluating the Integrated Census Israel Pnina ZADKA Central Bureau of Statistics Israel.
1 For a Population Statistical Register Characteristics and Potentials for the Official Statistics Central department for administrative data and archives.
Statistics Netherlands’ modernization programme: the use of administrative data, lessons learned and the way ahead. Geert Bruinooge Assistant Director.
Access to microdata in the Netherlands: from a cold war to co-operation projects Eric Schulte Nordholt Senior researcher and project leader of the Census.
1 1 Topics difficult to measure in a register-based census Harald Utne Census Project Statistics Norway UNECE-Eurostat Meeting on Population.
Representativity Indicators for Survey Quality Programme: Cooperation Theme: Socio-economic sciences and Humanities Activity: Socio-economic and scientific.
Could that be true? Methodological issues when deriving educational attainment from different administrative datasources and surveys Bart F.M. Bakker Manager.
© Statistisches Bundesamt, VI A Statistisches Bundesamt The new method of the next german Population census Johann Szenzenstein, Federal Statistical Office,
QUALITY ASSESSMENT OF THE REGISTER-BASED SLOVENIAN CENSUS 2011 Rudi Seljak, Apolonija Flander Oblak Statistical Office of the Republic of Slovenia.
Overview and challenges in the use of administrative data in official statistics IAOS Conference Shanghai, October 2008 Heli Jeskanen-Sundström Statistics.
Jacco Daalmans Estimation of Dutch census tables.
Census quality evaluation: Considerations from an international perspective Bernard Baffour and Paolo Valente UNECE Statistical Division Joint UNECE/Eurostat.
13-Jul-07 State of the art of the ISCO-08 implementation.
An Overview of Editing and Imputation Methods for the next Italian Censuses Gianpiero Bianchi, Antonia Manzari, Alessandra Reale UNECE-Eurostat Meeting.
1 A theoretical framework for register-based statistics --- Can we carry on without it? Li-Chun Zhang Statistics Norway
Small area estimation combining information from several sources Jae-Kwang Kim, Iowa State University Seo-Young Kim, Statistical Research Institute July.
INFO 7470/ECON 7400/ILRLE 7400 Register-based statistics John M. Abowd and Lars Vilhuber March 4, 2013 and April 4, 2016.
Administrative Data and Official Statistics Administrative Data and Official Statistics Principles and good practices Quality in Statistics: Administrative.
Methods for Data-Integration
Register-based census: Pros and Cons
Census developments in the Netherlands
Statistics Netherlands Division Social and Spatial Statistics
Census Planning and Management
Administrative Data and their Use in Economic Statistics
Overview of Approaches to Register-Based Populating Censuses
Key Considerations for Planning and Management of Census Operations
Technical Coordination Group, Zagreb, Croatia, 26 January 2018
Presentation transcript:

The Dutch Virtual Census of 2001 A New Approach by Combining Different Sources Eric Schulte Nordholt ECE Census meetings Geneva, November 2004

2 Contents Introduction Census Data sources Combining data sources: micro-linkage Combining sources: micro-integration Social Statistical Database (SSD) Census tables History of the Dutch Census Comparison with Censuses in other countries Conclusions

3 Introduction Census Why a Census ? Statistical information for research and policy purposes What kind of information ? Size of (sub)population(s) Demographic and socio-economic characteristics, at national and regional level Gentlemen’s agreement Eurostat: co-ordinator of EU, accesion and EFTA countries in the 2001 Census Round Census Table Programme, every 10 years

4 Data sources Registers: Population Register (PR), 16 million records demographic variables: sex, age, household status etc. Jobs file, employees, 6.5 million records, and self-employed persons, 790 thousand records dates of job, branch of economic activity Fiscal administration (FIBASE) jobs, 7.2 million records, and pensions and life insurance benefits, 2.7 million records Social Security administrations, 2 million records, auxiliary information integration process Surveys: Survey on Employment and Earnings (SEE), 3 million records, working hours, place of work Labour Force Survey (LFS), 2 years: records education, occupation, (economic) activity

5 Combining sources: micro-linkage Linkage key: Registers Social security and Fiscal number (SoFi), unique Surveys Sex, date of birth, address (postal code and house number) Linkage key replaced by RIN-person Linkage strategy Optimizing number of matches Minimizing number of mismatches and missed matches

6 Combining sources: micro-integration Collecting data from several sources  more comprehensive and coherent information on aspects of person’s life Compare sources - coverage - conflicting information (reliability of sources) Integration rules - checks - adjustments - imputations Optimal use of information  quality improves Example: job period vs. benefit period

7 Social Statistical Database (SSD) Social Statistical Database (SSD): Set of integrated micro-data files with coherent and detailed demographic and socio-economic data on persons, households, jobs and benefits No remaining internal conflicting information SSD-set: Population Register (back bone) Integrated jobs file Integrated file of (social and other) benefits Surveys, e.g. LFS Combining element: RIN-person

8 Census tables (1) Preliminary work before tabulating Census Programme definitions: not always clear and unambiguous, e.g. economic activity Priority rules (characteristics of) main job (highest wage) employee or employer job or (partially) unemployed job or attending education job or retired engaged in family duties or retired age restrictions Tabulating register variables: simply straightforward counting from SSD-register data

9 Census tables (2) Tabulating survey (and register) variables Mass imputation? Pro’s: reproducible results Con’s: danger of oddities in estimates (e.g. high educated baby) Traditional Weighting? Pro’s: simple, reproducible results (if same micro-data and weights) Con’s: no overall numerical consistency between survey and register estimates Demand for overall numerical consistency 1 figure for 1 phenomenon all tables based on different sources (e.g. surveys) should be mutually consistent

10 Census tables (3), example Ethnicity: register Education: survey 1 and survey 2 Employment status: survey 2 Estimate: T1: educ x ethnic and T2: educ x employ Survey 1 Survey 2 Register ethnic 1...k educ Lo... Hi employ 1...m educ x ethnic not- NL NLTotal educ Lo educ Hi Total employ x educ employednon- employed Total educ Lo educ Hi Total RegisterSurvey 1 Survey Total NLnot- NL ethnic

11 Census tables (4) Repeated Weighting (RW) : tool to achieve numerical consistency (VRD-software) Basic principles of RW: estimate table on most reliable source (mostly source with most records, e.g. register) estimate tables by calibrating on common margins of the current table and tables already estimated (auxiliary information) repeatedly use of regression estimator: - initial weights (e.g. survey weights) calibrated as minimal as possible - lower variances - no excessive increase of (non-response) bias (as long as cell size>>0) each table own set of weights

12 Census tables (5), example continued Survey 1 Survey 2 Register ethnic 1...k educ Lo... Hi employ 1... m RegisterSurvey 1 Survey 2 educ x ethnic not- NL NLTotal educ Lo educ Hi Total employ x educ employednon- employed Total educ Lo educ Hi Total ethnicnot- NL NL Total ethnicnot- NL NL Total Calibrate on ethnic, then on educ x ethnic

13 History of the Dutch Census TRADITIONAL CENSUS Ministry of Home Affairs: 1829, 1839, 1849, 1859, 1869, 1879 and 1889 Statistics Netherlands: 1899, 1909, 1920, 1930, 1947, 1960 and 1971 Unwillingness (non-response) and reduction expenses  no more Traditional Censuses ALTERNATIVE: VIRTUAL CENSUS 1981 and 1991: Population Register and surveys development 90’s: more registers → 2001: integrated set of registers and surveys, SSD

14 Comparison with Censuses in other countries Traditional Census (complete or partial enumeration): Most countries (Estonia, Slovenia, Greece and the UK) Mixture of traditional Census and Registers: Some countries (Norway and Switzerland) Entirely or largely register-based Census: A few Nordic countries (Sweden and Finland) Virtual Census: The Netherlands Tables: /census-2001.htmhttp:// 2001/census-2001.htm Book: htmhttp:// htm

15 Conclusions The Dutch Virtual Census 2001 was successful with its innovative approach: new source: SSD, integration of registers and surveys (micro-integration remains important) new methodology for consistent estimation was implemented Pro’s: relatively cheap (cost per inhabitant) and quick Con’s: publication of small subpopulations sometimes difficult or even impossible because of limited information Solutions for Con’s : small area estimation (synthetic estimators)