Work packages SGA II ESSnet on microdata linking and data warehousing in statistical production Harry Goossens – Statistics Netherlands Head Data Service.

Slides:



Advertisements
Similar presentations
The governance of metadata management in the S-DWH
Advertisements

ESSnet on Data Warehousing - WP2 Overview Amsterdam September 2013.
Best practice case: Comparing the implementations of the Irish CDM and the Dutch DSC ESSnet on microdata linking and data warehousing in statistical production.
March 2013 ESSnet DWH - Workshop IV DATA LINKING ASPECTS OF COMBINING DATA INCLUDING OPTIONS FOR VARIOUS HIERARCHIES (S-DWH CONTEXT)
Experiences from the Australian Bureau of Statistics (ABS)
United Nations Expert Group Meeting on Revising the Principles and Recommendations for Population and Housing Censuses New York, 29 October – 1 November.
International Seminar on Modernizing Official Statistics:
Metadata for the S-DWH ‒ an overview Lars-Göran Lundell Statistics Sweden.
Manual on Disability Statistics Central Statistics Office Ministry of Statistics & PI Government of India New Delhi.
Decentralised and Remote Access to Confidential Data in the ESS (ESSnet DARA) Overview and State of the Art Maurice Brandt Destatis FIRST EUROPEAN DATA.
Eurostat Round table CSPA & Big data
United Nations Statistics Division
WP.5 - DDI-SDMX Integration
TOWARDS INTEROPERABLE STATISTICAL BUSINESS REGISTERS Harrie van der Ven Project manager ESSnet EGR January 2014 Valencia.
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
SDMX and DDI Working Together Technical Workshop 5-7 June 2013
Initial thoughts on a Global Strategy for the Implementation of the SEEA Central Framework Ivo Havinga United Nations Statistics Division.
The Adoption of METIS GSBPM in Statistics Denmark.
Luisa Franconi Integration, Quality, Research and Production Networks Development Department Unit on microdata access ISTAT Essnet on Common Tools and.
Deliverable 2.6: Selective Editing Hannah Finselbach 1 and Orietta Luzi 2 1 ONS, UK 2 ISTAT, Italy.
ESS-net DWH ESSnet DWH - Metadata in the S-DWH Harry Goossens – Statistics Netherlands Head Data Service Centre / ESSnet Coordinator
Explaining the statistical data warehouse (S-DWH)
1 Conclusions from Sessions 4, 5, 6 Rapporteurs: Donatella Fazio, Istat Maria Grazia Calza, Istat Arianna Carciotto, Istat ESSnet Workshop 2012 Cavour.
ESSnet on Datawarehousing - the business register Pieter Vlag – Statistics Netherlands.
The Memobust Handbook on Methodology for Modern Business Statistics Sander Scholtus Rob van de Laar Leon Willenborg
Pierre TEILLET Vincent HECQUET 6 october 2009 ESSnet on profiling large and complex MNEs.
United Nations Economic Commission for Europe Statistical Division Mapping Data Production Processes to the GSBPM Steven Vale UNECE
United Nations Economic Commission for Europe Statistical Division Introduction to Steven Vale UNECE
ESSnet Workshop Cologne 2011 ESSnet on measuring global value chains.
ESSnet ON MICRO DATA LINKING AND DATA WAREHOUSING IN STATISTICAL PRODUCTION RESULTS OF STOCKTAKING, CONCLUSIONS OF FIRST YEAR * Pieter Vlag Senior Statistical.
© Federal Statistical Office, Research Data Centre, Maurice Brandt Folie 1 ESSnet Projects “Decentralised Access to EU microdata” Maurice Brandt Research.
Data without Boundaries A short Overview Coordination : Roxane Silberman CNRS/Réseau Quetelet P resented by Mike Priddy/DANS Iris Alfredsson/SND Cologne,
Regional Seminar on Promotion and Utilization of Census Results and on the Revision on the United Nations Principles and Recommendations for Population.
ESSNet workshop, Köln 27 October 2011 Eurostat Laboratory for developments in cross-cutting statistical domains Martina Hahn, Programme manager.
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
Work Session on Statistical Metadata 2013 Session III: Metadata in the Statistical Business Process Better documenting statistical business processes:
ESS-net DWH ESSnet on microdata linking and data warehousing in statistical production Harry Goossens – Statistics Netherlands Head Data Service Centre.
11 Centre of knowledge and expertise Data Warehousing ESSnet (DWH ESSnet)
RECENT DEVELOPMENT OF SORS METADATA REPOSITORIES FOR FASTER AND MORE TRANSPARENT PRODUCTION PROCESS Work Session on Statistical Metadata 9-11 February.
Standardisation in the European Statistical System inventory of normative documents and the standard-setting process – results of the ESSnet on Standardisation.
ESS-net DWH ESSnet on microdata linking and data warehousing in statistical production.
Harry Goossens Centre of Competence on Data Warehousing.
Best practice case Finland / Estonia 22th. of September 2011 Maia Ennok.
Slide 1DSS Board 1-2 December 2014 Eurostat ESS.VIP ADMIN project on use of administrative data sources Agenda point 7 DSS Board 1-2 December 2014.
Statistical process model Workshop in Ukraine October 2015 Karin Blix Quality coordinator
KOMUSO - ESSnet on quality of multisource statistics
Theme (iv): Standards and international collaboration
ESS Validation State of Play and next steps
Implementing the ESS Vision 2020
Project Coordination Group (PCG) for the implementation of the MSFD
Guidelines on the use of estimation methods for the integration of administrative sources DIME/ITDG meeting 2018/02/22.
DIME Plenary Thomas Burg –Statistics Austria
Methodology and Corporate Architecture
ESSnet on Data Warehousing 4th Workshop Maia Ennok 20th. of March 2013
2. An overview of SDMX (What is SDMX? Part I)
Methodology Working Group Luxemburg
Workshop on Decentralised Access to European Microdata
2. An overview of SDMX (What is SDMX? Part I)
ESS.VIP ADMIN Sorina Vâju.
WP7 – COMBINING BIG DATA - STATISTICAL DOMAINS
SDMX in the S-DWH Layered Architecture
ITDG meeting of of October 2011
GSBPM and Data Life Cycle
Alice Born, Statistics Canada
SISAI STATISTICAL INFORMATION SYSTEMS ARCHITECTURE AND INTEGRATION
ESS.VIP ADMIN EssNet on Quality in Multi-source Statistics, progress report 19TH WORKING GROUP ON QUALITY IN STATISTICS, 6 December 2016 Fabrice Gras,
ESS.VIP Validation Item 5.1
Metadata on quality of statistical information
ESS.VIP.SERV Shared Services
Presentation transcript:

Work packages SGA II ESSnet on microdata linking and data warehousing in statistical production Harry Goossens – Statistics Netherlands Head Data Service Centre / ESSnet Coordinator

ESS-net DWH 1 WP 1 - METADATA  Study and guidelines on metadata: what, wherefore, quality, details, … -Building a framework which defines metadata requirements and roles in the S-DWH context.  Study on the impact of the quality of statistical data and metadata in the area of micro data linking and data warehousing and vice versa and recommendations. Make maximum use of actions and results from other ESSnets on this area o.a. ESSnet on Admin Data).  Literature study on the use of metadata models and standards: -Gap and overlap analysis on existing metadata models (from other ESSnets, international projects, etc.); -Overview of and recommendations on the use of metadata models  Defining the various functionalities of a metadata system to facilitate and support the operation of the S-DWH.  Provide recommendations and guidelines on the governance of metadata management in the S-DWH.

ESS-net DWH 2 WP 2 - METHODOLOGICAL ASPECTS (1)  Build on the metadata framework (deliverable 1.1, WP 1) and evaluate it from a methodological viewpoint.  Study and recommendations on the position and role of the Business Register (BR) in the context of a S-DWH.  Examine selective editing options for the S-DWH and provide guidelines.  Study and recommendations on the various ways of "linking data" in the context of the S-DWH -Consider the data linking aspects of combining data (from surveys and administrative sources etc.) -Consider aspects of weighting aggregates and outliers -Inventory of deliverables of other ESSnets regarding micro data linking and recommendations on how to use them in relation to the S-DWH.

ESS-net DWH 3 WP 2 - METHODOLOGICAL ASPECTS (2)  Study on the impact of data confidentiality in the area of micro data linking and data warehousing; consider the confidentiality aspects of combining data (from surveys and administrative sources etc.) with respect to the S-DWH:  Including the European dimension: study and guidelines on the concepts of "ownership" (ensuring data quality) and "common validation" in the context of delivering data to Eurostat.  Produce a methodological mapping of the "GSBPM" (extended to cover administrative data) using the Business Architecture from WP 3. This should include an outline of where methodological gaps still exist when considering implementation of the SDWH.S-DWH.

ESS-net DWH 4 WP 3 - TECHNICAL ASPECTS (2)  Characterize the GSPBM sub processes to the S-DWH concept, providing a Business Architecture of the S-DWH  Study on change management and recommendations on the workflow of the S-DWH, including information logistics, the management of the information flow between data sources and S-DWH central administration.  Study on various technical aspects regarding the S-DWH (issues on performance, design etc.)  Define the architectural frameworks for the S-DWH on business statistics: Relate the 'ideal' architectural schemes (frameworks) into an actual implementation and development strategy.