Corporate Data Model (CDM) Underlying principle:4 datastores 1.INPUT-raw data 2.CLEAN UNIT-cleaned data 3.AGGREGATE-aggregated data 4.DISSIMINATION-published data CDM was seen as ≈ active DWH
Corporate Data Model (CDM) Main characteristics: All (statistical) processes must use the 4 datastores Processing systems interact on the data stores At some moments: snap shots, which build next data store It is possible to work further on the same (snap shotted) data store Simultanious updating of / on data is mainly organisational issue
Corporate Data Model CSO - Ireland INPUT CLEANED DATASETS AGGREGATE DATASETS DISSEMINATION DATA MANAGEMENT STORE ADMINISTRATIVE DATA CENTRE 2OPERATIONAL IMPLEMENTATIONS Surveys Admin data
Data Management Store (DMS) First implementation of CDM Mainly survey data Data tables are created and populated through the DMS applications. Metadata must be entered as the data tables are created. Metadata capturing = minimal bottleneck BR outside DMS (stand alone)
Corporate Data Model CSO - Ireland DATA COLLECTION ACTIVITIES INPUT CLEANED DATASETS AGGREGATE DATASETS DISSEMINATION DMSDMS APP – layer, incl. I/O interfaces DMS meta layer – Basic descriptions SHARED INPUT SHARED CLEANED UNIT AGGREGATE STORE SNAPSHOTS BIBI SYS 1 SYS 2 SYS n Mainly surveys
Administrative Data Centre (ADC) Developed for organisational reasons Only Admin data A catalyst to exploit administrative data for statistical purposes Interface with public authorities on admin data flows to CSO Clearing house inside CSO for admin data Data governance with respect to admin data
Administrative Data Centre (ADC) Has analysis layer R&D on available data To develop new datasets Without specific needs / demands from statistics
Corporate Data Model CSO - Ireland INPUT CLEANED DATASETS AGGREGATE DATASETS DISSEMINATION ADCADC ADC meta layer BIBI SYS 1 SYS 2 SYS n DATA COLLECTION ACTIVITIES SOURCES Data Products ETLETL ADC Front Door LEAN INTERFACE Only Admin Data
Corporate Data Model CSO - Ireland DATA COLLECTION ACTIVITIES INPUT CLEANED DATASETS AGGREGATE DATASETS DISSEMINATION DMSDMS ADCADC APP – layer, incl. I/O interfaces DMS meta layer – Basic descriptions ADC meta layer SHARED INPUT SHARED CLEANED UNIT AGGREGATE STORE SNAPSHOTS BIBI SYS 1 SYS 2 SYS n DATA COLLECTION ACTIVITIES SOURCES Data Products ETLETL ADC Front Door LEAN INTERFACE