Statistisches Bundesamt eSTATISTIK.core: AN XML-BASED APPROACH TO DATA COLLECTION FROM ERP SYSTEMS Joint ECE/Eurostat/OECD Meeting on the Management of Statistical Information Systems (MSIS) (Bratislava, Slovakia, April 2005) Michael Schäfer - IT-Development - Federal Statistical Office, Germany

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt Profile of eSTATISTIK.core CORE = Common Online Raw Data Entry „Common“: a single point of delivery (URL) regardless of survey and collecting office Economic statistics Integrates IT systems of reporting businesses and administrations and those of the collecting offices Allows automated reporting (compilation, transmission, validation, forwarding, transformation) Can significantly reduce the burden of respondents Generic (XML, metadata-driven software)

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt Political and organisational frame Co-operation with the targeted user community Respondents, service providers and software producers (Lufthansa, Datev, SAP, Peoplesoft, Oracle, UBM, …), represented by the AWV (Working Party for Economical Administration); WG established in early 2003 Part of the common strategic program of the German statistical offices („Masterplan“, „eSTATISTIK“) Submitted to the national eGovernment initiative „Deutschland Online“ for standardisation

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt Data Collection Server Recognition, validation, forwarding Architecture of eSTATISTIK.core HTTPS (OSCI) Stat. Office Stat. Office Stat. Office Stat. Office DatML/RAW Raw data DatML/ASK Questionnaire definition DatML/RES Protocol DatML/SDF Survey definition ERP system Statistics module CORE.connect HR Accoun- ting Etc. Compilation, validation, download, upload, authentication (user, passw.) + history, user mgmt, forms CORE.reporter CORE.connect ASCII CSV ECXEL Etc.

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt Metadata management Web Service Resource DB MySQL Statspez SDF EditorData Edit Designer Questionnaire Editor Word, Acrobat DatML/SDFDatML/EDT (+variables) DatML/ASK DatML/MAP Dataset definition (INI) documentation Java classes Stat. Office Stat. Office Stat. Office Linux Resource id after release: statistics.refp.offid.restype.ver

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt Components of eSTATISTIK.core 1.Infrastructure A single point of delivery on the internet 2.Data Standardised XML document types for raw data, survey definitions and protocols 3.Client software Libraries for integration into ERP systems (CORE.connect) A stand-alone application with an interactive GUI (CORE.reporter) Compilation, upload, download, validation 4.Server software Java-based server applications Recognition, validation, decompilation and forwarding Protocol management

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt Features of the common raw data entry Automated detection, validation & forwarding of raw data messages for any survey and any collecting office Validation against electronic survey definitions (Automated) download of survey definitions and protocols Identification and authentication of respondents by means of user id and password Secure transmission (HTTPS, OSCI)

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt XML document types DatML/RAW for statistical raw data Generic, cross-survey, supports third-party reporting and collection Supports acknowledgement requests, testing, address updates A single document may contain any number of raw data messages DatML/SDF for survey definitions Survey identification, reference period, periodicity, etc. Input and output data models (variables and structures) Useful for both compiling and validating DatML/RAW documents DatML/RES for protocols For documenting delivery and validation of DatML/RAW documents Generic, cross-survey, supports third-party reporting and collection

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt Supporting software: CORE.connect Business data repository ERP system DatML/SDF Statistics module CORE.connect DatML/RAW Software library for easy implementation of eSTATISTIK.core into business IT systems (ERP systems)

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt Supporting software: CORE.connect Supports respondents and software producers in the implementation of eSTATISTIK.core Supports/provides client-side functionalities Compilation Validation against DatML/SDF survey definitions Automated connecting, authentication and upload Automated download of DatML/SDF and DatML/RES documents Transport protocols: HTTPS, OSCI (Online Services Computer Interface (planned)) APIs: JAVA, C/C++ (JNI)

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt Supporting software: CORE.reporter DatML/SDF Data (ASCII-CSV, EXCEL,... ) CORE. reporter CORE.connect DatML/RAW Java application with GUI for creating DatML/RAW messages from files (mapping approach) and forms (off-line) HTTPS / OSCI

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt Supporting software: CORE.reporter Targets respondents without ERP systems (small businesses) Features Stand-alone Java application with a GUI, using CORE.connect Mapping facilities for loading raw data from files (CSV, EXCEL, will be extended) Support of forms (DatML/ASK) for entry and display of raw data (planned) User / client management for third-party respondents, history Uses CORE.connect for validation, download and upload Driven by DatML/RES survey definitions

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt Project state Productive for two selected wage statistics since March 2005 (CeBIT). Supporting software released in March 2005 Statistics modules to be implemented by SW producers (SAP, ORACLE, PeopleSoft, DATEV, P&I, UBM Drecker) by mid-2005 To be productive for selected economic statistics by the fourth quarter of 2005.

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt Information and contacts: eSTATISTIK.core: Mr. Christian Bösnecker, phone 0611/ , Mr. Michael Schäfer, phone 0611/ ,

© Statistisches Bundesamt, Referat II C 4 Statistisches Bundesamt Thank you very much for your attention! Any questions?