Corporate Data Model (CDM) Underlying principle:4 datastores 1.INPUT-raw data 2.CLEAN UNIT-cleaned data 3.AGGREGATE-aggregated data 4.DISSIMINATION-published.

Slides:



Advertisements
Similar presentations
NEFIS (WP5) Evaluation Meeting, November 2004 Evaluation Data Rights Aljoscha Requardt, University of Hamburg Response Rate: 91% - 10 of 11 partners.
Advertisements

ESSnet on Data Warehousing Centre of Competence
Input Data Warehousing Canada’s Experience with Establishment Level Information Presentation to the Third International Conference on Establishment Statistics.
Best practice case: Comparing the implementations of the Irish CDM and the Dutch DSC ESSnet on microdata linking and data warehousing in statistical production.
Realizing the statistical potential of administrative data Paper presented at the U.N.E.C.E. Seminar on New Frontiers for Statistical Data Collection,
CZECH STATISTICAL OFFICE | Na padesatem 81, Prague 10 | Jitka Prokop, Czech Statistical Office SMS-QUALITY The project and application.
Developing a System for Web Based Data Dissemination CSO Experience Strategies for Web based Data Dissemination Ghusoon M. Hameed IRAQ.
Census.ac.uk Census Area Statistics and Casweb David Rawnsley Census Dissemination Unit (CDU) Mimas University of Manchester.
The use and convergence of quality assurance frameworks for international and supranational organisations compiling statistics The European Conference.
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
1 OECD Experience from SHA Collection 7th Meeting of Health Accounts Experts and Correspondents for Health Expenditure Data Paris, September, 2005.
Using ISO/IEC to Help with Metadata Management Problems Graeme Oakley Australian Bureau of Statistics.
ESSnet DataWareHousing Stocktaking Pieter Vlag, Viviana di Giorgi, Sonia Queresma.
1 Data, Information and Knowledge in the British Geological Survey Jeremy Giles.
Person Activity Register - a statistical register of persons Administrative Statistics Seminar Dublin Castle 20 th Feb 2014
Combining survey and administrative data to create a new input data file for National Accounts processes Shaun McLaughlin Central Statistics Office, Ireland.
Explaining the statistical data warehouse (S-DWH)
Copyright 2010, The World Bank Group. All Rights Reserved. ICT - a core management issue Part 1 Managing ICT resources Produced in Collaboration between.
Monitoring public satisfaction through user satisfaction surveys Committee for the Coordination of Statistical Activities Helsinki 6-7 May 2010 Steve.
Statistics New Zealand’s End-to-End Metadata Life-Cycle ”Creating a New Business Model for a National Statistical Office if the 21 st Century” Gary Dunnet.
The CSO’s IT Strategy – using the GSBPM to support good governance MSIS 2010 – Daejeon April 2010 Joe Treacy Central Statistics Office.
Implementation Experiences METIS – April 2006 Russell Penlington & Lars Thygesen - OECD v 1.0.
Developing Statistical Information Systems and XML Information Technologies - Possibilities and Practicable Solutions Geneva,
DWH Aggregate Statistics Aggregate Statistics Microdata Dataset Business register Storage, combination OutputsInput data 1.The magic data pixie model.
EC-GIS, Lyon, June Meta data Meta what !?! Tim Hancock.
Reducing Respondent Burden The Australian Bureau of Statistics Experience Integrated Economic Statistics / Joint FSO-UNSD work session, 6-8 June 2007,
ESSnet ON MICRO DATA LINKING AND DATA WAREHOUSING IN STATISTICAL PRODUCTION RESULTS OF STOCKTAKING, CONCLUSIONS OF FIRST YEAR * Pieter Vlag Senior Statistical.
Alternative Architecture for Information in Digital Libraries Onno W. Purbo
Statistics New Zealand's Move to Process-oriented Statistics Production Julia Gretton and Tracey Savage IAOS Conference Shanghai, China, October 2008.
1 The United Nations Demographic Yearbook and the Work Programme for Social Statistics Expert Group Meeting to Review the United Nations Demographic Yearbook.
Business model Transformation Strategy (BmTS) John Pearson and Tracey Savage Statistics NZ’s.
Work packages SGA II ESSnet on microdata linking and data warehousing in statistical production Harry Goossens – Statistics Netherlands Head Data Service.
IT Directors Group, Luxembourg, October Statistics for a Modern Ireland CSO Data Management System (DMS) Update Joe Treacy Director, IT and.
Database Systems Database Systems: Design, Implementation, and Management, Rob and Coronel.
ABS Statistical Databases Session 6 Mark Viney Australian Bureau of Statistics 6 June 2007.
ESS-net DWH ESSnet on microdata linking and data warehousing in statistical production Harry Goossens – Statistics Netherlands Head Data Service Centre.
Welcome and opening remarks DWH Workshop Dublin, 23 September 2015 Central Statistics Office, Ireland 1 Joe Treacy Director of Business Statistics and.
The CSO’s IT Strategy and the GSBPM IT Directors Group October 2010 Joe Treacy Central Statistics Office Ireland.
Role of the IMDB in the CBA and IM Strategy Presented to Information Management Committee Standards Division June
Realising the statistical potential of administrative data on air passenger traffic Niall O’Hanlon Session 16 IAOS 2008 Shanghai.
ESS-net DWH ESSnet on microdata linking and data warehousing in statistical production.
CSO ITSIP Project - implementation of new Data Management System (DMS) ITDG meeting, Luxembourg, October 2006 Presentation by Joe Treacy CSO, Ireland.
Use of Standardized Metadata to Find, Select and Access Statistical Data - Experience of Statistics Canada - Joint UNECE/Eurostat/OECD Work Session on.
Keeping Children Safe Summer School.... Pathways to information 15 th September 2011
1 Case Study Integrated Metadata Driven Statistical Data Management System (IMD SDMS) CSB of Latvia METIS 2010.
Harry Goossens Centre of Competence on Data Warehousing.
1 Joint UNECE/Eurostat Seminar on Migration Statistics Geneva March 2005 International Migration Statistics: Current Activities of the United Nations.
Evaluation Experts Meeting, DG AGRI L4, Brüssel, The Monitoring- and Evaluation System of the Austrian RDP Karl M. Ortner (AWI) Otto.
Metadata models to support the statistical cycle: IMDB
Administrative Data Centre (ADC) ……. a GDPR ready data hub?
Seminar on ESA 2010 Metadata
GCC Stat Initiatives on Civil Registration and Vital Statistics in GCC Countries 2018م.
CENTRAL STATISTICS OFFICE IRELAND ITSIP PROJECT OVERVIEW
Data Interoperability and User USGS User Management
S-DWH layered architecture – Statiscs Finland
Organisational design and transformation approach
Generic Statistical Business Process Model (GSBPM)
Working Group on Population and Housing Censuses
YTY − an integrated production system for business statistics
ESSnet on Data Warehousing 4th Workshop Maia Ennok 20th. of March 2013
Methodology Working Group Luxemburg
Integrated Statistical Information System (ISIS) in Croatia By Maja Ledić Blažević, Senior Advisor, Research & Development Dept. and Branka Cimermanović,
Role of Metadata in Census Data Dissemination
SDMX in the S-DWH Layered Architecture
Metadata The metadata contains
GSBPM and Data Life Cycle
Statistical Information Framework at CSO - A Beginning
Metadata use in the Statistical Value Chain
Introduction to reference metadata and quality reporting
Interoperability of metadata systems: Follow-up actions
Presentation transcript:

Corporate Data Model (CDM) Underlying principle:4 datastores 1.INPUT-raw data 2.CLEAN UNIT-cleaned data 3.AGGREGATE-aggregated data 4.DISSIMINATION-published data  CDM was seen as ≈ active DWH

Corporate Data Model (CDM) Main characteristics: All (statistical) processes must use the 4 datastores Processing systems interact on the data stores At some moments: snap shots, which build next data store It is possible to work further on the same (snap shotted) data store Simultanious updating of / on data is mainly organisational issue

Corporate Data Model CSO - Ireland INPUT CLEANED DATASETS AGGREGATE DATASETS DISSEMINATION DATA MANAGEMENT STORE ADMINISTRATIVE DATA CENTRE 2OPERATIONAL IMPLEMENTATIONS Surveys Admin data

Data Management Store (DMS) First implementation of CDM Mainly survey data Data tables are created and populated through the DMS applications. Metadata must be entered as the data tables are created. Metadata capturing = minimal  bottleneck BR outside DMS (stand alone)

Corporate Data Model CSO - Ireland DATA COLLECTION ACTIVITIES INPUT CLEANED DATASETS AGGREGATE DATASETS DISSEMINATION DMSDMS APP – layer, incl. I/O interfaces DMS meta layer – Basic descriptions SHARED INPUT SHARED CLEANED UNIT AGGREGATE STORE SNAPSHOTS BIBI SYS 1 SYS 2 SYS n Mainly surveys

Administrative Data Centre (ADC) Developed for organisational reasons Only Admin data A catalyst to exploit administrative data for statistical purposes Interface with public authorities on admin data flows to CSO Clearing house inside CSO for admin data Data governance with respect to admin data

Administrative Data Centre (ADC) Has analysis layer R&D on available data To develop new datasets Without specific needs / demands from statistics

Corporate Data Model CSO - Ireland INPUT CLEANED DATASETS AGGREGATE DATASETS DISSEMINATION ADCADC ADC meta layer BIBI SYS 1 SYS 2 SYS n DATA COLLECTION ACTIVITIES SOURCES Data Products ETLETL ADC Front Door LEAN INTERFACE Only Admin Data

Corporate Data Model CSO - Ireland DATA COLLECTION ACTIVITIES INPUT CLEANED DATASETS AGGREGATE DATASETS DISSEMINATION DMSDMS ADCADC APP – layer, incl. I/O interfaces DMS meta layer – Basic descriptions ADC meta layer SHARED INPUT SHARED CLEANED UNIT AGGREGATE STORE SNAPSHOTS BIBI SYS 1 SYS 2 SYS n DATA COLLECTION ACTIVITIES SOURCES Data Products ETLETL ADC Front Door LEAN INTERFACE