COMMON STATISTICAL PRODUCTION ARCHITECTURE WHERE ARE WE ? June 2106 By Bruno URBAN.

Slides:



Advertisements
Similar presentations
ESS VIP PROGRAMME An overview ESSNet workshopWG LUXEMBOURG 22/11/2012.
Advertisements

1 SDMX Reference Infrastructure (SDMX-RI) Work in progress, status and plans Bengt-Åke Lindblad, Adam Wroński Eurostat Eurostat Unit B3 – IT and standards.
Introduction to SDMX Seminar Eurostat/ECLAC 02 October 2012 August Götzfried Head of Unit, Eurostat B5 Management of statistical data and metadata.
Case Studies Slovenia Julija Kutin METIS Workshop on the Statistical Business Process and Case.
APPLIED GSBPM IN GSO by Ha Do Statistical Standard Methodology and ITC Department General Statistic Office Vietnam 1 General statistic office Vietnam.
by Ha Do Statistical Standard Methodology and ITC Department
The use and convergence of quality assurance frameworks for international and supranational organisations compiling statistics The European Conference.
Background Data validation, a critical issue for the E.S.S.
World Bank, Africa Region, Africa Household Survey Databank - The World Bank - Africa.
Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and.
Update on the activities of the OECD’s Statistical Information System Collaboration Community MSIS - May 2012.
Overview of SDMX: Statistical Data and Metadata eXchange Technical and Content Standards for Statistical Data Ann McPhail, Division Chief Statistics Department,
Vincenzo Del Vecchio Banca d’Italia Statistics Collection and Processing Department 2012 ESSnet Workshop – 4 December.
CASE STUDY: STATISTICS NORWAY (SSB) Jenny Linnerud and Anne Gro Hustoft Joint UNECE/Eurostat/OECD work session on statistical metadata (METIS) Luxembourg.
How to implement an SDMX architecture for dissemination and reporting
SDMX and DDI working together Technical workshop, Luxembourg, June 2013 Use cases for DDI and SDMX.
Eurostat F - Break-Out Sessions SDMX RI User Group Luxembourg, September 2013.
ESS-net DWH ESSnet DWH - Metadata in the S-DWH Harry Goossens – Statistics Netherlands Head Data Service Centre / ESSnet Coordinator
Luxembourg January CORE ESSnet (COmmon Reference Environment) final meeting Carlo Vaccari Istat - Italy.
United Nations Economic Commission for Europe Statistical Division Standards and Statistical Production Architectures Steven Vale UNECE
> 1 Eurostat meeting 5-7 June 2013 Draft ´ Mogens Grosen (Statistics Denmark)
SMAP 5 - Kickoff 19 March IBM Smarter Planet Agenda Introductions Background (SMAP) Proposed Component Model General discussion on approach An overview.
Promoting the use of SDMX WPTGS November Presentation contents: 1. What is SDMX? 2. SDMX: NSI Perspective 3. OECD SDMX work 4. How SDMX is used.
1 Meeting on the Management of Statistical Information Systems (MSIS 2010) SDMX architecture for data sharing and interoperability Francesco Rizzo, ISTAT,
Statistical Metadata Strategy and GSIM Implementation in Canada Statistics Canada.
Web based tools for Raw Data collection Bertrand Loison, Chief Information Officer (CIO) Eurostat / IT Directors Group / / Luxembourg Swiss.
SDMX IT Tools Introduction
Progress OpenEdge Analytics360 Predicting The Future Of Your Business Michael Marriage Senior Principal Product Manager
SDMX IT Tools SDMX Reference Infrastructure
United Nations Economic Commission for Europe Statistical Division International Collaboration to Modernise Official Statistics Steven Vale UNECE
An overview of SDMX November Presentation contents: 1. What is SDMX? 2. SDMX: NSI Perspective 3. OECD SDMX work 4. How SDMX is used in sharing and.
1 National Statistical Coordination Board Philippine Implementation Plan of SDMX Overview of the Philippine Implementation Plan of SDMX Model and Technology.
Eurostat 6. SDMX: A non-technical overview of the SDMX architecture and IT tools 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services”
1 High Level Seminar for Eastern Europe, Caucasus and Central Asia Countries (EECCA). Quality in Statistics: Metadata Tbilisi, Georgia, June 2012.
United Nations Economic Commission for Europe Statistical Division Standards-based Modernisation Steven Vale UNECE
UNECE / Eurostat Workshop on Implementing CSPA – Geneva – June 2016 ESSNet on Sharing Common Functionalities
Statistical Information Systems Introducing SIS tool .Stat
Prepared by: Galya STATEVA, Chief expert
CS 577b: Software Engineering II
The evolution of the SDMX infrastructure and services
The role of statistical standards in Building National Data Backbones
BSA 385 Competitive Success-- snaptutorial.com
BSA 385 Education for Service-- snaptutorial.com
BSA 385 Teaching Effectively-- snaptutorial.com
BSA 385 Inspiring Innovation-- snaptutorial.com
Using the Checklist for SDMX Data Providers
(VIP-EDC) Point 6 of the agenda
SDMX Reference Infrastructure Introduction
SISAI STATISTICAL INFORMATION SYSTEMS ARCHITECTURE AND INTEGRATION
Presentation contents:
Integrated Statistical Information System (ISIS) in Croatia By Maja Ledić Blažević, Senior Advisor, Research & Development Dept. and Branka Cimermanović,
Introduction to DDI and Colectica at Statistics Denmark
SDMX implementation at Eurostat and in the Member States
Working Group on Population and Housing Censuses
Statistical Information Technology
RAMON Re-engineering An Update
CORA ESSNet COmmon Reference Architecture starting ...
The basics ESSnet on SDMX prepared in 2008/2009
ESS VIP ICT Project Task Force Meeting 5-6 March 2013.
SDMX and implications for the ESS
Management of Statistical Information Systems – MSIS report 2006 lars
European Census Hub: a cooperation model for dissemination of EU statistics Paper prepared by Ioannis Xirouchakis Presentation: Christine WIRTZ, Eurostat.
M. Henrard, B5 N. Buysse and H. Linden, B6 Eurostat
ESTP Training Course “Enterprise Architecture and the different EA layers, application to the ESS context ” Rome, 16 – 19 October 2017.
Eurostat Unit B3 – IT and standards for data and metadata exchange
SDMX IT Tools SDMX Registry
SDMX IT building blocks
High-Level Group for the Modernisation of Official Statistics
Presentation transcript:

COMMON STATISTICAL PRODUCTION ARCHITECTURE WHERE ARE WE ? June 2106 By Bruno URBAN

Project board H2Project board H1 Project board v1 From a “siloed” organization … Directorate vertical Production/Dissemination systems Statistical horizontal systems Dissemination Production Roles Functional analysis Technical analysis Development Support Specific Methodology Practice Environment Technology Team H1 Roles Functional analysis Technical analysis Development Support Specific Methodology Practice Environment Technology Team V1 Roles Functional analysis Technical analysis Development Support Specific Methodology Practice Environment Technology Team H2 Shared aspects … common methodology\mid set …

.. to a “practice building” orientated organization Product Vision Project Management Product Analysis Back log management Community Management Agility Management Product/Project Management Business Process Analysis Advanced Seminar User/community support Smart Data Framework Data and tool migration Practice building Technical vision Product development/support Technical Proof of Concepts Development methodology Performance monitoring Incident Management Software architecture Solution building Dissemination Production Prince 2 (project board) + Agile 2 Scrum Teams 2 weeks sprints 1 demo 6 months vision 4 sprints packages User Relationship Stakeholder Relationship Supplier Relationship

JS App. SDMX flows between layers and systems Dissemination Production SDMX Eurostat SDMX NSI Web Service (using SDMX Source) Worflow & State Engine (exposed as a service) Common structure/data management SDMX JS App. SDMX JavaScript SDMX library Reusable Web Components (React + Redux) Front end team focused on the reusable web components’ framework reusable web components JavaScript applications Back end team focused on: the NSI connectors on the Json format support in SDMXSource common structure/data management tool Json Storages will be exposed as services

Survey 2 Production tool SDMX flows for data collection & analysis Dissemination Production SDMX Eurostat SDMX NSI Web Service (using SDMX Source) Eurostat SDMX Source library OECD Data, wizard (Excel plugin) SDMX IMF External sources Version 1 Version 2 Survey & Questionnaire tools WS Etc. Version 1

Finish SDMX implementation Calculation engine (exposed as a service) Metadata management (exposed as a service) MarkLogic used as a storage for all qualitative data (first) Use big data strategies/infrastructure for data collection/analysis/dissemination (parallel computing, etc.) Next steps