1. © Metadata Technology ESCWA SDMX Workshop Session: SDMX and a Re-usable Component Architecture

2. © Metadata Technology Goals Language Independent Architecture High Cohesion Loose Coupling Program to Interfaces – Not Implementations

3. © Metadata Technology SDMX-ML is for EXCHANGE between systems The SDMX Information Model is where the power is Use the Model

4. © Metadata Technology Finding the Common Model

5. © Metadata Technology What is Data? Results of Measurements Country: UK Unemployed: 13million Year: 2010 Country: France Unemployed: 5million Year: 1982 Country: Australia State : Perth Coastline (Km): 12500

6. © Metadata Technology Modelling Data KEY Values Country : UK Type : Real Basket : Narrow Country : UK Basket : Narrow Time Period : 2000-01 Type : Real Value : 107.8 Type : Nominal Value : 104.8 Time Period : 1999-10 Value : 106.34 Time Period : 2001-02 Value : 101.73

7. © Metadata Technology Compact 2.0 “Compact” 2.1 Compact 2.0 To 2.1 Transformation “Compact” 2.1 To 2.0 Transformation Simple Data Transformation Model

8. © Metadata Technology Compact 1.0 Generic 1.0 Utility 1.0 Compact 2.0 Generic 2.0 Utility 2.0 Structure Specific 2.1 Generic 2.1 EDI CSV ??? Simple Data Transformation Model

9. © Metadata Technology Data Reader Interface Data Writer Interface Read KeyRead Observation Write KeyWrite Observation Compact Generic EDI Compact Generic EDI Decoupled Data Transformation Model

10. © Metadata Technology Summary so far Good design protects software from change Finding a common model means everything can be reused

11. © Metadata Technology Break Down The Problem Creating Sub-Systems

12. © Metadata Technology Make a Generic Solution Each aspect of a system can be broken down into a sub-system Each sub-system has a specific responsibility

13. © Metadata Technology Break down the Problem SDMX breaks down nicely into sub systems Structure Validation Data Validation Data Transformation Data Reading Data Writing Structure Transformation Generating a Data Query Consuming a Data Query Consuming a Structure Query Generating a Structure Query Querying a File Calling a Web Service with a Structure Query

14. © Metadata Technology Interfaces can be reused BeanRetrievalManager File RetrievalIn Memory RetrievalWeb Service Retrieval

15. © Metadata Technology Database User Data Query Web Service Database Administrator Response Format? Request Format? Implementing a Web Service for Data

16. © Metadata Technology Database User Data Query Web Service SDMX Query Data ParserData Query Engine Data Writer Build Data Query Bean From Any version of SDMX Query Consumes SDMX query, and gets parser to create bean Passes Query to Database layer, along with Data Writer A powerful concept of passing an interface with useful methods such as : startSeries(…), addObservation(…) addAttribute(…) Internally the DataWriter wraps an output stream, and writes SDMX straight to the output stream. What Implements Data Writer? Generic Data Writer Compact Data Writer Utility Data Writer EDI Data Writer ??? Implementing a Web Service for Data