Role of editing and imputation in integration of sources for structural business statistics Svein Gåsemyr, Statistics Norway Svein Nordbotten, University.

Slides:



Advertisements
Similar presentations
Estimates and sampling errors for Establishment Surveys International Workshop on Industrial Statistics Beijing, China, 8-10 July 2013.
Advertisements

Eurostat Secondary data: collection and use Presented by Arnout van Delden Methodologist Statistics Netherlands.
Sampling Frames for Establishment Surveys International Workshop on Industrial Statistics Beijing, China, 8-10 July 2013.
Business Register Outputs in Support of Regional Policy John Perry UK Office for National Statistics.
Using Administrative Data to Improve Social Statistics – An Example of Collaborative Work Minda Phillips, Office for National Statistics. Paul Sinclair,
June 2009 Brazilian Economic Statistics Program. Up to mid 1990’s the organization of Brazilian Economic Statistics Program was based in Economic Censuses.
Counting the Dutch, The Future of the Virtual Census in the Netherlands Presentation at the seminar Counting the 7 Billion 24 February 2012 * Geert Bruinooge.
UNECE Work Session on Statistical Data Editing Vienna April 2008 Topic ii – Editing Administrative Data and Combined Sources.
1 Editing Administrative Data and Combined Data Sources Introduction.
Nordisk Statistikermøde i København august 2010 The archive statistical method years - A Summary by Svein Nordbotten 8/11/20101Svein.
1 Linking micro data. Some Norwegian experiences Øyvind Hagen Statistics Norway Nordic meeting, Faeroe Islands September
© John M. Abowd 2005, all rights reserved Using the Economic Census and Business Register John M. Abowd February 2005.
1 Potential New Content and Structures for the U.S. Census Bureau’s Business Register Shirin A. Ahmed and Eddie J. Salyers U.S. Census Bureau United States.
1 The Business Register: Introduction and Overview Ronald H. Lee
Iman El Hitta Economic Statistical Sector, Central Agency
Data Sharing to Reduce Respondent Burden for the U.S. Census Bureau’s Business Register Presented to 12 th Meeting of the Group of Experts on Business.
Editing and imputation for the creation of a linked file from base registers and other administrative data Svein Gåsemyr, Statistics Norway.
1 1 Establishing a register-based statistical system Example: Population and housing censuses in Norway Statistical Training Course Use of Administrative.
Regional GDP Workshop. Purpose of the Project October Regional GDP Workshop Regional GDP Scope Annual Current price (nominal) GDP By region.
Microdata on Trade in Services – data set and empirical findings, the case of Austria 2nd Meeting of the Working Party on International Trade in Goods.
1 BUSINESS REGISTER CBS-ISRAEL. 2 LEGAL FRAME WORK in 1997 two inter-governmental committees issued: 1. LEGAL ASPECTS 2. PRACTICAL & TECHNICAL ASPECTS.
CZSO Business Register in the Czech Statistical Office Prepared by: Jan Matejcek CZSO, Prague, Czech Republic
Quality in the Swedish Business Database The Quality Survey 2004 Round Table Beijing 2004 Swedish presentation, session 5, 18 th Round Table, Beijing –
1 Business Register: Quality Practices Eddie Salyers
The Canadian Integrated Approach to Economic Surveys Marie Brodeur, Peter Koumanakos, Jean Leduc, Éric Rancourt, Karen Wilson Statistics Canada International.
Use of survey (LFS) to evaluate the quality of census final data Expert Group Meeting on Censuses Using Registers Geneva, May 2012 Jari Nieminen.
Dutch Virtual Census Presentation at the International Seminar on Population and Housing Censuses; Beyond the 2010 Round November, 2012 Egon Gerards,
The Statistical Business Register of Macao SAR Government of Macao SAR Statistics and Census Service.
12th Meeting of the Group of Experts on Business Registers
Record matching for census purposes in the Netherlands Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics Netherlands.
All the answers? Statistics New Zealand’s Integrated Data Infrastructure Paper by Felibel Zabala, Rodney Jer, Jamas Enright and Allyson Seyb Presented.
Register-Based Census 2011 in Slovenia – Some Quality Aspects Danilo Dolenc Statistical Office of the Republic of Slovenia UNECE-Eurostat Expert Group.
Imputation and Editing of Income from the Administrative File in Israel ’ s Censuses prepared by Orly Furman and Dmitri Romanov UNITED NATIONS ECONOMIC.
Implementation of quality indicators in the Finnish statistics production process Kari Djerf Statistics Finland Q2008, Rome Italy.
Register-based migration statistics and using additional administrative data sources Barica Razpotnik Statistical Office of the Republic of Slovenia UNECE.
Longitudinal Data Recent Experience and Future Direction August 2012.
European Conference on Quality in Official Statistics Session 26: Quality Issues in Census « Rome, 10 July 2008 « Quality Assurance and Control Programme.
The Dutch Virtual Census based on registers and already existing surveys Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics.
Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.
1 1 Metadata for the Norwegian outward FATS Which of the following approaches best describes the methodology adopted to produce outward FATS population?
New sources – administrative registers Genovefa RUŽIĆ.
Editing of linked micro files for statistics and research.
© Federal Statistical Office Germany, Division IB, Institute for Research and Development in Federal Statistics Sheet 1 Surveys, administrative data or.
1 Economic Census : The First Experience of Morocco Kingdom of Morocco Department of planning Directorate of Statistics The Second International Workshop.
SNA seminar in the Caribbean Integrated questionnaires Marie Brodeur Director General, Industry Statistics Branch, Statistics Canada St. Lucia February,
The challenge of a mixed-mode design survey and new IT tools application: the case of the Italian Structure Earning Surveys Fabiana Rocci Stefania Cardinleschi.
Developing and applying business process models in practice Statistics Norway Jenny Linnerud and Anne Gro Hustoft.
1 M Gouws – Stats SA Business Register (UNSD regional workshop) Presentation to UNSD regional workshop for African countries – Basic economic statistics.
Who trades services across the Austrian border? Providing structural information on basis of micro data Global Forum on Trade Statistics Patricia Walter.
1 Statistical business registers as a prerequisite for integrated economic statistics. By Olav Ljones Deputy Director General Statistics Norway
Session 3 The population registers in Germany – the main data source in the 2011 Census UNECE-Eurostat Expert Group Meeting on Censuses Using Registers.
RECENT DEVELOPMENT OF SORS METADATA REPOSITORIES FOR FASTER AND MORE TRANSPARENT PRODUCTION PROCESS Work Session on Statistical Metadata 9-11 February.
S T A T I S T I K A U S T R I A Quality Assessment of register-based Statistics A Quality Framework Manuela LENK Directorate.
The Setup of the Register of Addresses and Buildings of the German 2011 Census Data quality issues and solutions.
How to develop cooperation between government agencies on data collection Experiences from Republic of Kazakhstan and Kyrgyz Republic Prepared by Mrs.
Unified Enterprise Survey New Horizons International Conference on Establishment Surveys Daniela Ravindra and Marie Brodeur Montreal, June 2007 Statistics.
CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic Business Register in the Czech Statistical Office =DISSEMINATION.
The use of administrative data for the production of official economic statistics in Brazil - current situation and challenges for the future Shanghai,
Guidelines on Statistical Business Registers. Draft Chapter 6: Data Sources Andrew Allen UK.
1 Overview of the U.S. Census Bureau’s Business Register Profiling Operations Presented to International Roundtable on Business Survey Frames– Wiesbaden.
Measuring Data Quality in the BLS Business Register Richard Clayton Sherry Konigsberg David Talan WiesbadenGroup on Business Registers Tallin, Estonia.
Re-engineering the French Business Register ( )
Guidelines on the use of estimation methods for the integration of administrative sources DIME/ITDG meeting 2018/02/22.
Prague EU-SILC Best Practice Workshop, 14th and 15th September 2017
Nils Petter Skirstad Statistics Norway
Find the Taylor series for f (x) centered at a = 8. {image} .
Issues in Administrative Data
Evaluating the Completeness of the Civil Registration System
Evaluating the Completeness of the Civil Registration System
Presentation transcript:

Role of editing and imputation in integration of sources for structural business statistics Svein Gåsemyr, Statistics Norway Svein Nordbotten, University of Bergen

Contents of paper Data sources for business statistics Methods for integration of sources Use of standard models for processes The need to measure quality of linked files Work to be done

Interaction of sources and modules The statistical business register The database to coordinate samples The micro file of statistical surveys The database of available data The menu of data editing imputation and estimation

Data sources to be integrated for business statistics by ISEE

Administrative business registers that are affiliated to the Legal Unit Register Employer Register Business Enterprise Register Value Add Tax Register Tax register of business enterprises and self-employed

Enterprises and establishment of manufacturing industry Complex enterprises1086 –Establishments1 768 Single enterprises

Establishment by sources A. Census survey2 096 B. In sample and selected1 251 C. In sample and not selected1 092 D. Small complex establishment 319 E. Establishment excluded

Methods for integration Linkage at unit level Editing of a single source and linked files Estimation by mass imputation

Process errors in integrated records Errors due to incomplete registers Linking errors Observation errors Errors made during editing Imputation errors

Units identification in 2 registers Units in register 1:Not existi ng Incorrectly existing Existing with incorrect ID Existing with correct ID Sum Units in register 2: Not existing in register Incorrectly existing Existing with incorrect ID Existing correct Sum

Statistical quality indicators Process accuracy – Statistical accuracy Quality of administrative data A single source A linked file of 2 sources A linked file of a large number of sources A small evaluation sample Deviation between processes data value and the correct value

Work to be done Improve the system for unit identification Develop the standard processing system Evaluation by controlled experiments Designing suitable evaluation samples Use of process data for process design