Case Study Statistics Netherlands Max Booleman Statistics Netherlands METIS, 2010.

Slides:



Advertisements
Similar presentations
Input Data Warehousing Canada’s Experience with Establishment Level Information Presentation to the Third International Conference on Establishment Statistics.
Advertisements

Best practice case: Comparing the implementations of the Irish CDM and the Dutch DSC ESSnet on microdata linking and data warehousing in statistical production.
Mogens Grosen Nielsen Statistics Denmark
Implementation of GSBPM, DDI and SDMX reference metadata at Statistics Denmark UNECE workshop 5-7 May 2015 Mogens Grosen Nielsen
Design Plans CSCI102 - Systems ITCS905 - Systems MCS Systems.
Producing and managing metadata Workshop on Writing Metadata for Development Indicators Lusaka, Zambia 30 July – 1 August 2012 Writing Metadata for Development.
WP.5 - DDI-SDMX Integration
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
Quality Management System BY CDR ALOK MOHAN
Case Studies: Statistics Canada (WP 11) Alice Born Statistics UNECE Workshop on Statistical Metadata.
Data Warehousing at STC MSIS 2007 Geneva, May 8-10, 2007 Karen Doherty Director General Informatics Branch Statistics Canada.
M ETADATA OF NATIONAL STATISTICAL OFFICES B ELARUS, R USSIA AND K AZAKHSTAN Miroslava Brchanova, Moscow, October, 2014.
The value added of a national statistical institute Max Booleman Marleen Verbruggen.
Interactive session: Mapping the BPM-Notation on a SDWH layered architecture Discussion on Vision in sub groups.
Metadata for a Statistical Data Warehouse Lars-Göran Lundell Statistics Sweden Luxembourg 22 September 2011.
The Adoption of METIS GSBPM in Statistics Denmark.
Statistics Sweden Results from operations in 2006: 146 publications 356 press releases commissions 3,7 million visitors at
Eurostat Overall design. Presented by Eva Elvers Statistics Sweden.
Metadata Models in Survey Computing Some Results of MetaNet – WG 2 METIS 2004, Geneva W. Grossmann University of Vienna.
Current and Future Applications of the Generic Statistical Business Process Model at Statistics Canada Laurie Reedman and Claude Julien May 5, 2010.
ESS-net DWH ESSnet DWH - Metadata in the S-DWH Harry Goossens – Statistics Netherlands Head Data Service Centre / ESSnet Coordinator
CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic Statistical Business Process in the Czech Statistical Office.
Explaining the statistical data warehouse (S-DWH)
Statistics New Zealand’s End-to-End Metadata Life-Cycle ”Creating a New Business Model for a National Statistical Office if the 21 st Century” Gary Dunnet.
United Nations Economic Commission for Europe Statistical Division Mapping Data Production Processes to the GSBPM Steven Vale UNECE
Implementation Experiences METIS – April 2006 Russell Penlington & Lars Thygesen - OECD v 1.0.
ESSnet ON MICRO DATA LINKING AND DATA WAREHOUSING IN STATISTICAL PRODUCTION RESULTS OF STOCKTAKING, CONCLUSIONS OF FIRST YEAR * Pieter Vlag Senior Statistical.
Chapter © 2012 Pearson Education, Inc. Publishing as Prentice Hall.
1 1 Developing a framework for standardisation High-Level Seminar on Streamlining Statistical production Zlatibor, Serbia 6-7 July 2011 Rune Gløersen IT.
Developing and applying business process models in practice Statistics Norway Jenny Linnerud and Anne Gro Hustoft.
Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,
A modular metadata-driven statistical production system The case of price index production system at Statistics Finland Pekka Mäkelä, Mika Sirviö.
© Statistisches Bundesamt, I/A Case study Federal Statistical Office Germany (Destatis) Joint UNECE/ EUROSTAT/ OECD Work Session on Statistical Metadata.
Metadata Framework for a Statistical Data Warehouse
ESS-net DWH ESSnet on microdata linking and data warehousing in statistical production.
CSO ITSIP Project - implementation of new Data Management System (DMS) ITDG meeting, Luxembourg, October 2006 Presentation by Joe Treacy CSO, Ireland.
1 Case Study Integrated Metadata Driven Statistical Data Management System (IMD SDMS) CSB of Latvia METIS 2010.
Describe a layered S-DWH Technology Architecture Information Systems Architecture Business Architecture.
Elaborating on the Business Architecture of SN Robbert Renssen Statistics Netherlands Standard Process Steps.
Statistical process model Workshop in Ukraine October 2015 Karin Blix Quality coordinator
Enterprise Architectures Course Code : CPIS-352 King Abdul Aziz University, Jeddah Saudi Arabia.
ROMA 23 GIUGNO 2016 MODERNISATION LAB - FOCUSSING ON MODERNISATION STRATEGIES IN EUROPE: SOME NSIS’ EXPERIENCES Insert the presentation title Modernisation.
Standard Process Steps in Statistics Robbert Renssen Statistics Netherlands Robbert Renssen and Astrea Camstra, Statistics Netherlands.
Towards connecting geospatial information and statistical standards in statistical production: two cases from Statistics Finland Workshop on Integrating.
The Generic Statistical Information Model (GSIM) and the Sistema Unitario dei Metadati (SUM): state of application of the standard Cecilia Casagrande –
Process and Quality metadata
CENTRAL STATISTICS OFFICE IRELAND ITSIP PROJECT OVERVIEW
A generic production environment - use of GSIM in Statistics Sweden
Data management and the Production of Statistics Geert Bruinooge Deputy Director General Statistics Netherlands Seminar on Innovations in Official Statistics.
at Statistics Netherlands
Methodology and Corporate Architecture
Generic Statistical Business Process Model (GSBPM)
Measuring Data Quality and Compilation of Metadata
YTY − an integrated production system for business statistics
Tomaž Špeh, Rudi Seljak Statistical Office of the Republic of Slovenia
Metadata in the modernization of statistical production at Statistics Canada Carmen Greenough June 2, 2014.
Working on coherence and consistency of an output database
Standard Process Steps in Statistics
Max Booleman Statistics Netherlands
Mapping Data Production Processes to the GSBPM
Metadata used throughout statistics production
Statistical process as a structured chain of successive actions and intermediate products, supported by the coherent use of metadata  Focused on energy.
Presentation to SISAI Luxembourg, 12 June 2012
GSBPM AND ISO AS QUALITY MANAGEMENT SYSTEM TOOLS: AZERBAIJAN EXPERIENCE Yusif Yusifov, Deputy Chairman of the State Statistical Committee of the Republic.
ESTP course on Statistical Metadata – Introductory course
COmmon REference Environment - CORE:
Work Session on Statistical Metadata (Geneva, Switzerland May 2013)
Introduction to reference metadata and quality reporting
CSPA Templates for sharing services
CSPA Templates for sharing services
Presentation transcript:

Case Study Statistics Netherlands Max Booleman Statistics Netherlands METIS, 2010

Outline of presentation 1.Architecture 2.Relation with GSBPM 3.Interrelated processes and GSBPM 4.Business Principles 5.Steady States 6.Metadata model 7.Challenges 8.Lessons learned

Business Architecture

Business Architecture- Output driven Client Customer Source Respondent

Business Architecture- Layers Statistics Production Chain Management Design Shared service: Data Service Centre

The BA principles of SN 10 main principles. Examples are A strict distinction is made between the data that are actually processed and the metadata that describe the definitions, the quality and the process activities During the design of the statistical process, the benefits of re-use are exploited to the maximum degree, both within and outside Statistics Netherlands Steady states are explicitly designed for re-use. The metadata (of steady states) are generally accessible and are standardised as much as possible The production of statistics is output-driven Observational inputdata are stored as observed (in the inputbase). Publishable outputdata are stored as published (in the outputbase).

Business Architecture- Steady states inputbase microbase statbase outputbase pre-inputbase post-outputbase Data and metadata (including quality)  Quality control  Chain management  Re-use of data Central role in (re)design and production Access through central Data Service Centre

Relation with GSBPM Not covered by GSBPM GSBPM 4 till 7 Chain Management GSBPM 1 till 3 Not covered by GSBPM Steady states

Interrelated processes and GSBPM Population, Units, Registers Large Units STS SBS SNA External Output M,Q,Y Y Q, Y Y Y

What are Steady States? A steady state is a data set together with information for its correct interpretation. Rectangular Rows represent units (micro) or classes of units (macro) Columns represent variables Heading: population, time Dataset design (vary time): in design phase Dataset design is like a template of a table: only borders and heading 1 Dataset design, n Datasets

Why Steady States? 1.Reduce storage: store once, re-use many times 2.Secure the process 3.Improve consistency 4.Improve flexibility: time to market Steady States: corner stone of BA

Metadata classified according to three criteria (1) First criterion: when it is developed. Ex ante metadata is developed during the first three phases of the Generic Statistical Business Process Model (GSBPM): Specify needs, Design and Build. Ex post metadata is developed during each production run. These consist of the other phases of GSBPM.

Metadata classified according to three criteria (2) Second criterion: the function of the metadata. Here we distinguish four types of metadata: conceptual, process, quality and technical metadata. For instance, ex ante process metadata will tell you how statistics should be produced. Ex post process metadata tells you how they were produced.

Metadata classified according to three criteria (3) Third criterion: quality. Metadata in our pre-input and input bases are formulated according to the respondent's wording. Metadata in our other bases are formulated according the office standards. These also contain explicitly the international standards.

Dutch metadata model Dedicated model to –describe Datasets including process and quality metadata –ex ante in Dataset design –ex post in Dataset –find datasets Inspired (among others) by Swedish model and Neuchâtel Treats micro data and macro data differently

Micro model

Macro model

Challenges Quality of metadata will become a high priority issue in the (near) future. ISO presents some guidelines and rules. Acceptance of Data Service Centre by the business. Data Service Centre implies a new way of working and an additional workload for producers. The benefits are for the users of the data and not in first place for the producers. So we have to convince the producers to spend time and money on it. Additional Workload. Metadata should be made during the development phase of a project. But if you want to store existing datasets (our history) in the Data Service Centre it means an additional workload for a production environment.

Lessons learned 1.A metadata model serves the functions you need 2.There is no universal model 3.No model without explicit formulation of required functionality 4.Limit the functions of the model 5.Start small, think broad 6.Quality of metadata often a forgotten issue 7.There was no business case for metadata but there is a business case for Steady States.