SDMX data discovery, query, and visualisation within Excel Chris Nelson Metadata Technology
Why Integrate with Excel? Excel is a familiar desktop tool Used to import data (usually as CSV) View data as tables and charts Manipulate data It is not typically used to query data sources Therefore the choreography of accessing data in Excel has multiple steps This choreography does not lend itself to data discovery and query
Typical Choreography for Data Query and Viewing in Excel Data Web Service query User Interface response Download as CSV save view load
Solution Develop an add-in for Excel that can: Interface to a web service that Delivers information on data sources (what is available) Delivers information that can be used to query data sources – wherever they are Queries the data sources Delivers data and corresponding structural metadata that enables intelligent display of data Possibility to provide data manipulation useful for statisticians and analysts (extrapolation, seasonal adjustment)
Simple Web Services for Data Discovery & Visualisation Architecture Simple Web Services for Data Discovery & Visualisation Fusion Cube Fusion Cube uses structural information to build a rich & powerful model. (DSD/Codelists/Concepts/HCL/Constraints/Structure Maps/MSD) It exposes the information via a set of simple web services tailored to aid data discover and data visualisation We are in the proccess of building an Excel client to use this information to assist in both data discovery and data visualisation We would like to work with NcomVA to help us incorporate visual widgets that can be used by clients to assemble a data dissemination system SDMX Web Service SDMX Web Service SDMX Web Service Structural Metadata Data Quality Metadata
Architecture: Interfaces REST JSON Simple Web Services for Data Discovery & Visualisation Fusion Cube Fusion Cube uses structural information to build a rich & powerful model. (DSD/Codelists/Concepts/HCL/Constraints/Structure Maps/MSD) It exposes the information via a set of simple web services tailored to aid data discover and data visualisation We are in the proccess of building an Excel client to use this information to assist in both data discovery and data visualisation We would like to work with NcomVA to help us incorporate visual widgets that can be used by clients to assemble a data dissemination system SDMX Web Services SDMX Web Service SDMX Web Service SDMX Web Service Structural Metadata Data Quality Metadata
Data Discovery and Query Support in SDMX Data Structure Definition Category Scheme Category Categorisation Data Flow Data Provider Scheme Drill Down Query Provision Agreement Data Provider Discover Register Data Discovery and Query Support in SDMX Registered Data Source Data Source references Content Constraint
Step 1: Select Topic SDMX Structures User View in Excel Ribbon Web Services
Step 2: Select Dimensions Data Structure Definition Data Flow
Step 3: Make Dimension Selections
Step 4: Submit Query User View in Excel Ribbon SDMX Structures Web Services
Step 5: View Data
Step 6: Pivot table