Sander Scholtus and Leon Willenborg Editing and Imputation in the Memobust Handbook.

Slides:



Advertisements
Similar presentations
© Statistisches Bundesamt, B 2 / Institut für Forschung und Entwicklung in der Bundesstatistik Statistisches Bundesamt ESSnet on Preparation of Standardisation.
Advertisements

ESSnet on Data Warehousing - WP2 Overview Amsterdam September 2013.
WSIS + 10 review meeting “Towards Knowledge Societies for Peace and Sustainable Development” Measurement of the WSIS targets within UNESCO’s fields of.
Results and next steps from the ESSnet Admin Data Alison Pritchard Business Outputs & Developments, Office for National Statistics, UK 4 December 2012.
Recent international developments in Energy Statistics United Nations Statistics Division International Workshop on Energy Statistics September 2012,
Decentralised and Remote Access to Confidential Data in the ESS (ESSnet DARA) Overview and State of the Art Maurice Brandt Destatis FIRST EUROPEAN DATA.
Eurostat Statistical Data Editing and Imputation.
Combining administrative and survey data: potential benefits and impact on editing and imputation for a structural business survey UNECE Work Session on.
United Nations Statistics Division
Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and.
European Conference on Quality in Official Statistics (Q2010) 4-6 May 2010, Helsinki, Finland Brancato G., Carbini R., Murgia M., Simeoni G. Istat, Italian.
1 The system aspect of statistical quality Q2014 european conference on quality in official statistics Special session: Consistency of Concepts and Applied.
Development of Censuses in Europe and Development for EC Statistical Co-operation European Commission (Eurostat) Jurgen Heimann UNFPA/PARIS 21 International.
Introduction and key issues identified in the papers UNECE Conference of European Statisticians June 2015 Second Seminar, Session I.
Development of metadata in the National Statistical Institute of Spain Work Session on Statistical Metadata Genève, 6-8 May-2013 Ana Isabel Sánchez-Luengo.
ESSnet Workshop Rome December Rome 2012 Memobust: harmonisation and integration issues Rob van de Laar Division of Process development, IT and Methodology.
"Automated data collection in accommodation statistics: a European overview" Rome, 3 rd December 2012.
OECD Short-Term Economic Statistics Working PartyJune Establishing guidelines for creating long time series for short-term economic statistics.
Essential SNA Project being developed from 2011 to 2013.
Deliverable 2.6: Selective Editing Hannah Finselbach 1 and Orietta Luzi 2 1 ONS, UK 2 ISTAT, Italy.
CZECH STATISTICAL OFFICE 1 The Quality Metadata System In the Czech Statistical Office Work Session on Statistical Metadata (METIS)
CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 1 Subsystem QUALITY in Statistical Information System Czech.
1 OECD Workshop on Business and Consumer Tendency Surveys, Rome, 19 September 2006 SESSION 1 RECENTLY DEVELOPED INTERNATIONAL GUIDELINES FOR OPINION SURVEYS.
Eurostat The impact of the Memobust project results.
The MEMOBUST project Ágnes Andics EESW Nürnberg 1.
Explaining the statistical data warehouse (S-DWH)
Recommended Practices for Editing and Imputation in the European Statistical System: the EDIMBUS Project* Orietta Luzi (Istat, Italy) Ton De Waal (Statistics.
LPP-LDV-TOI-09-IT-0503 Project Presentation. LPP-LDV-TOI-09-IT-0503 What is the LeTS GO project? The LeTS Go project has been financed by the European.
Jenny Linnerud, 27/10/2011, Cologne1 ESSnet CORE Common Reference Environment ESSnet workshop in Cologne 27th and 28th of October 2011.
Introduction 1. Purpose of the Chapter 2. Institutional arrangements Country Practices 3. Legal framework Country Practices 4. Preliminary conclusions.
The Memobust Handbook on Methodology for Modern Business Statistics Sander Scholtus Rob van de Laar Leon Willenborg
Weighting and estimation methods: description in the Memobust handbook Loredana di Consiglio, Fabrizio Solari 2013 European Establishment Statistics Workshop.
Statistik.atSeite 1 Norbert Rainer Quality Reporting and Quality Indicators for Statistical Business Registers European Conference on Quality in Official.
United Nations Economic Commission for Europe Statistical Division High-Level Group Achievements and Plans Steven Vale UNECE
Me thodology for mo dern bu siness st atistics = Memobust Leon Willenborg (Statistics Netherlands)
Topic (iii): Macro Editing Methods Paula Mason and Maria Garcia (USA) UNECE Work Session on Statistical Data Editing Ljubljana, Slovenia, 9-11 May 2011.
Outlining a Process Model for Editing With Quality Indicators Pauli Ollila (part 1) Outi Ahti-Miettinen (part 2) Statistics Finland.
The implementation programme for the 2008 SNA and supporting statistics UNECE special session on National Accounts for economies in transition Geneva,
United Nations Economic Commission for Europe Statistical Division Knowledge Management and Information Sharing: The Structure of UNECE’s work on Gender.
ESS-net DWH ESSnet on microdata linking and data warehousing in statistical production Harry Goossens – Statistics Netherlands Head Data Service Centre.
Essnet STAND-PREP Rome, 6-7 June 2011 Rome, 6-7 June 2011 ESSnet “Preparation of standardisation” WP1 report: outline of the report, content, responsibility.
Generic Statistical Data Editing Models (GSDEMs) Workshop on the Modernisation of Official Statistics The Hague, 24 November 2015.
Standardisation in the European Statistical System inventory of normative documents and the standard-setting process – results of the ESSnet on Standardisation.
1 The GSBPM and ESS statistical business process metadata Session 4 H. Linden, Unit B6 Eurostat Workshop on Statistical Metadata (METIS) (Geneva, 5-7 October.
Report on the breakout session on Rapid Estimates Roberto Barcellan European Commission - Eurostat.
ESS-net DWH ESSnet on microdata linking and data warehousing in statistical production.
The business process models and quality issues at the Hungarian Central Statistical Office (HCSO) Mr. Csaba Ábry, HCSO, Methodological Department Geneva,
What is metadata? Anne Gro Hustoft, Statistics Norway
Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 1 Topic (vii): New and emerging methods Introduction Session organizers:
Overview of Programme of the Working Group on Flash Estimates of GDP Roberto Barcellan European Commission - Eurostat.
Review of the UNECE Glossary of Terms on Statistical Data Editing Paper by Statistics New Zealand’s Editing and Imputation Methodology Network Presented.
United Nations Statistics Division Developing a short-term statistics implementation programme Expert Group Meeting on Short-Term Economic Statistics in.
Statistical Business Register Enterprise Groups in Latvia Sarmite Prole Head of Business Register Section Business Statics Department Central Statistical.
The Suitland Working Group: Using Household Surveys to Measure Migration and Migrant Populations Victoria A. Velkoff Assistant Division Chief, Estimates.
Theme (iv): Standards and international collaboration
Generic Statistical Data Editing Models (GSDEMs)
The ESS vision, ESSnets and SDMX
WORKSHOP GROUP ON QUALITY IN STATISTICS
Essnet on Methodology for Modern Business Statistics
2. An overview of SDMX (What is SDMX? Part I)
Working Group European Statistical System – Learning and Development Framework (ess-ldf) & Human Resources Management (hrm) Item 8.b of the agenda Luxembourg,
ESS Standardisation State of play
The MEMOBUST project Ágnes Andics EESW Nürnberg
CORA ESSNet COmmon Reference Architecture starting ...
Ag.no Dissemination of A64 data
Network of Methodologists
Quality Assurance in the European Statistical System
Education and Training Statistics Working Group – 2-3 June 2016
MEETING OF THE WORKING GROUP ON CULTURE STATISTICS 23-24/11/2016
1. Mission of EGR and legal framework
Presentation transcript:

Sander Scholtus and Leon Willenborg Editing and Imputation in the Memobust Handbook

Outline – The Memobust project – The Memobust handbook – Editing and Imputation in the handbook – Concluding remarks 2

The Memobust project – Memobust = Methodology of Modern Business Statistics – ESSnet project, ran from January 2011 to March 2014 – Project team: NSIs of Netherlands (project co-ordinator) Hungary Italy Norway Poland Sweden Switzerland Greece (first half only) 3

The Memobust project – Motivation: ‐ European Statistical System (ESS) ‐ Identification of best practices ‐ Development of common methodology and guidelines supporting the production of business statistics ‐ Integration of existing data sources 4

The Memobust project – Operational objective: produce a handbook on methodology for the production of business statistics ‐ Intended as an update of an existing handbook (1998) ‐ Special focus on ‘new’ developments: design of statistical processes data collection estimation data integration ‐ Comply with GSBPM ‐ Sustainable → not a traditional handbook 5

The handbook – scope – The handbook is about ‐ methods that are currently used (or could be used) to produce business statistics within the ESS ‐ some related aspects (e.g., process design, quality) – The handbook is not about ‐ laws, regulations, etc. ‐ official definitions of concepts → for this, see the Manual on European Business Statistics produced by FRIBS 6

The handbook – intended readership – Persons working in the area of business statistics ‐ survey managers ‐ process designers ‐ statisticians ‐ methodologists ‐ (users) 7

The handbook – form and appearance – Appearance: ‐ interconnected set of separate documents: modules ‐ available as PDF files on the internet: – Modules arranged into topics ‐ 104 modules (+ introduction), 22 topics ‐ Examples of topics: Statistical Data Editing Imputation – Glossary ‐ 695 terms with 764 definitions 8

The handbook – form and appearance – Two types of modules in the handbook: ‐ Themes general, broad readership ‐ Methods specific, more technical – Both types of modules have a fixed format (template) 9

The handbook – possible uses – Source of knowledge / aid in designing and running business statistics – Information for users of business statistics – Material for courses on methodology – Starting point for tool development – Facilitate the discourse on statistical methods and harmonisation at the European level 10

Editing and Imputation – Modules in the topic “Statistical Data Editing”: 1.Main Module (theme) 2.Deductive Editing (method) 3.Selective Editing (theme) 4.Automatic Editing (method) 5.Manual Editing (method) 6.Macro-Editing (theme) 7.Editing Administrative Data (theme) 8.Editing for Longitudinal Data (theme) – Total number of pages:

Editing and Imputation – Modules in the topic “Imputation”: 1.Main Module (theme) 2.Deductive Imputation (method) 3.Model-Based Imputation (theme) 4.Donor Imputation (theme) 5.Imputation for Longitudinal Data (theme) 6.Little and Su Method (method) 7.Imputation under Edit Constraints (theme) – Total number of pages: 84 12

Editing and Imputation 13 Contributors to these topics EditingImputation WritingReviewingWritingReviewing M. Di ZioXX M. L. FerraroXX A. R. GiorgiXX R. GismondiXX U. GuarneraX O. LuziX F. RocciXX S. ScholtusXX S. BergX E. ElversX A. NorbergX J. SvenssonX Z. CserehatiX G. HorvathX Ø. LangsrudX

Editing and Imputation – In addition: module “Editing During Data Collection” in the topic “Questionnaire Design” ‐ Author: P. Lańduch ‐ Reviewers: D. Beukenhorst, D. Giesen A. Norberg 14

Editing and Imputation – Aim of the handbook: summarise existing knowledge, provide references for more details – Key references for Editing and Imputation: ‐ EDIMBUS Manual (2007) ‐ Handbook by De Waal, Pannekoek & Scholtus (2011) ‐ UNECE Glossary of Terms on SDE (2000) ‐ UNECE Work Sessions on SDE 15

Concluding remarks – Project finished, handbook supposed to live on – Possible future developments: ‐ Update existing topics/modules ‐ Add new topics/modules ‐ Transform to a different environment (e.g., wiki) – Required: ‐ Active group of moderators and contributors Perhaps UNECE Work Sessions could contribute? ‐ Some form of financial support “Centre of competence”? Series of small dedicated projects? 16

Concluding remarks Thank you for your attention! 17