Demography applications of SDMX Giuseppe SINDONI, Unit B3 Item 2.1.5 of the Agenda Demography applications of SDMX Giuseppe SINDONI, Unit B3 15 & 16 October 2007 IT Directors Group

Motivations Proposal for a regulation on population and housing censuses (Feb 2007) Harmonisation of censuses Output oriented Reduction of burden on MS Adoption of the appropriate technical format Need to collect and disseminate aggregates 15 & 16 October 2007 IT Directors Group

Data requirements Data on different topics Population and Housing Data at different levels of detail Hierarchical classifications (age groups, occupation sectors, …) NUTS 1 to 3 Confidentiality issues Secondary disclosure control Different rules in different countries 15 & 16 October 2007 IT Directors Group

Organisational requirements Data to be transmitted in 27 months from the reference year Data may be transmitted by countries as soon as they are available Countries responsible for quality of their own data Eurostat to collect and disseminate 15 & 16 October 2007 IT Directors Group

Technical requirements A central dissemination site for country data Need to have a common transmission format Infrastructure to Collect data asynchronously Perform validation (which kind?) Publish data on the Web 15 & 16 October 2007 IT Directors Group

The hub approach Based on data sharing a group of partners agree on providing access to their data according to standard processes, formats and technologies. 15 & 16 October 2007 IT Directors Group

Notification Census hub Updates metadata Notify availability of hypercubes MS 1 MS 2 MS n … 15 & 16 October 2007 IT Directors Group

User interaction Census hub MS 1 MS 2 MS n … Requests a dataset 15 & 16 October 2007 IT Directors Group

Querying Census hub Query sent to MSs WSs MS 1 MS 2 MS n … 15 & 16 October 2007 IT Directors Group

Replies Census hub Query processed and results sent MS 1 MS 2 MS n … 15 & 16 October 2007 IT Directors Group

Result presented Census hub Replies put together MS 1 MS 2 MS n … Dataset presented Census hub Replies put together MS 1 MS 2 MS n … 15 & 16 October 2007 IT Directors Group

Technological standards SDMX XML format (SDMX-ML) hypercube structures and data files query reference metadata provision agreement SDMX registry architecture back-end metadata repository SDMX WS architecture interaction between systems Web feeds (RSS, Atom) 15 & 16 October 2007 IT Directors Group

Evaluation of pilot phase Roadmap 2007Q3: selection of two or three volunteer NSIs for a pilot phase 2007Q4: requirement specifications for the pilot phase 2008Q2: pilot phase end Evaluation of pilot phase 2008Q4: start of hub project 2010Q3: hub ready for production 15 & 16 October 2007 IT Directors Group

Issues Technological readiness of MS Organisational readiness of MS survey carried out in 2007Q1: all respondent countries (16) will most likely have a DW for Census data dissemination Organisational readiness of MS more than one department involved (Census, IT, Integration, …) Technical issues performances: some data caching system could help improve response times to final users XML compression techniques to enable transmission of large hypercubes Backup solution a mixed approach, where some countries send SDMX-ML hypercubes to Eurostat, to be centrally stored 15 & 16 October 2007 IT Directors Group