1. Eurostat November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange Jean-Francois LEBLANC Christian SEBASTIAN SDMX IT Tools SDMX Information Model, Structures and Messages

2. Eurostat Table of Contents 1.SDMX Information Model 1.Base Package 2.SDMX 2.0 -> 2.1 3.Inheritance Relationship 2.Main SDMX-ML structures 1.Concept Scheme 2.CodeList 3.DSD 4.Example on NA: DSD 2.0 5.Example on NA: DSD 2.1 2

3. Eurostat Table of Contents 3.SDMX-ML messages 1.SDMX-ML messages 2.0 2.SDMX-ML messages 2.1 3.SDMX-ML messages 2.0 vs 2.1 3

4. Eurostat 1. SDMX Information Model 4 Structure Definition Data & Metadata Flows Provision Agreement Data Provider Data & Metadata Set Constraint Category Scheme Category Categorization

5. Eurostat 1. SDMX Information Model SDMX-IM is a conceptual meta-model from which syntax specific implementations are developed SDMX-IM provides for the structuring of data/metadata The model is split in three conceptual layers: SDMX Base Structural Definitions Reporting and Dissemination 5

6. Eurostat 1.1 Base Package Inheritance Relationship Maintainable Artefacts ItemScheme [ConceptSchemes, CodeLists, CategorySchemes, OrganisationSchemes] Structure [Data (and Metadata) Structure Definition] StructureUsage [Dataflow (and Metadataflow) Definition] Versionable Artefacts Item [Concepts, Codes, Categories, Organisations, DataProviders, DataConsumers, MaintenanceAgencies 6

7. Eurostat 1.1 Base Package Inheritance Relationship Identifiable Artefacts only Component [Dimensions, Attributes, Measures] ComponentList [KeyDescriptor, GroupKeyDescriptor, MeasureDescriptor, AttributeDescriptor] DataSet XSDataSet 7

8. Eurostat 1.2 SDMX 2.0  2.1 SDMX 2.1 SDMX 2.0 SDMX 1.0 8

9. Eurostat Maintainable artefact 1.2 SDMX 2.0  2.1 Constraint Version 2.0 Version 2.1 Constraint Dataflow Provision agreement Dataflow CodeList Provision agreement DSD 9

10. Eurostat 1.2 SDMX 2.0  2.1 Code List Common Code list Constraint 1 Partial DSD Constraint 2 Version 2.1 10

11. Eurostat 2. Main SDMX-ML Structures Code Lists Codes and descriptions Concept Schemes Concepts used to describe statistical dimensions, measures, attributes Data Structure Definitions Structural definitions for data sets Concepts and code lists define dimensions, measures, cross sectional measures and attributes 11

12. Eurostat 2.1 Concept Scheme Demography domain concept scheme Frequency Reporting Country Time format code Time period or range Observation Value Observation Status Population on 1 January of Year X … 12 The header contains the following tags: Id agencyID Version isFinal This is the body with the elements of the artefact

13. Eurostat 2.2 CodeList Frequency code list Annual Daily Half- yearly Monthly Quarterly Weekly 13

14. Eurostat 2.3 DSDs Define the valid content for Data Sets Comprises Dimensions o Define the key descriptor for reporting Data Sets Attributes o Report additional data o Can be attached at four possible levels (Observation, Series, Group, Data Set) Measures o Data that can be reported Groups o Grouping of dimensions (in order to attach group attributes) Example with National Accounts (NA_MAIN) 14

15. Eurostat 2.4 Example on NA: DSD 2.0 15

16. Eurostat 2.5 Example on NA: DSD 2.1 16

17. Eurostat 3.1 SDMX-ML Messages (2.0) Used for representing data Contain related metadata as defined in DSDs Four different representations available in 2.0 Generic messages Compact messages Utility messages Cross-Sectional messages Each representation serves different purposes *Exception: Time Dimension not defined. 17

18. Eurostat 3.1.1 SDMX 2.0 Generic Data 18

19. Eurostat 3.1.2 SDMX 2.0 Compact data 19

20. Eurostat 3.1.3 SDMX 2.0 Utility Data 20

21. Eurostat 3.1.4 SDMX 2.0 Cross-Sectional 21

22. Eurostat 3.2 SDMX-ML Messages (2.1) Two types of message available in SDMX 2.1 GenericData messages StructureSpecificData messages To allow for applications which only understand time series data, there are particular cases for those 2 formats: GenericTimeSeriesData StructureSpecificTimeSeriesData 22

23. Eurostat 3.2.1 SDMX 2.1 Generic 23

24. Eurostat 3.2.2 SDMX 2.1 Structure specific 24

25. Eurostat 3.3 SDMX-ML messages 2.0 vs 2.1 25 Version 2.0Version 2.1 Generic Data Structure Specific Data CrossSectional Data Compact Data Utility Data Generic Data TS Structure Specific Data TS

26. Eurostat 26 SDMX messages and structures