1. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 1 Subsystem QUALITY in Statistical Information System Czech Statistical Office Head of Modelling and Quality of Statistical Processing Section European Conference on Quality in Official Statistics 2008 10 July 2008 Jitka Prokop

2. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 2 Topics  Statistical Information System (SIS)  Statistical Meta-information System (SMS) Its role in the SIS  QUALITY Subsystem of SMS

3. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 3 Statistical Information System (SIS)

4. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 4 Statistical Information System (SIS) Features  Focus from quantity to quality. Indicators like CV or response rates shall have higher significance when making decisions.  Priority from survey to statistical variable – mutual relations between statistical tasks, preparation of samples is coordinated – reduction of respondent burden, increase of coherence

5. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 5 Statistical Information System (SIS) Frameworks, Components  Three components  Content component  Meta-information component (SMS subsystems incl. Q-subsystem)  Statistical information and technological (IT) component

6. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 6 Statistical Information System (SIS) Subsystems  Subsystems for particular stages of ST  Integration Tools  Meta-information System  Data Warehouse  Administrative Data Registers  ICT Support Subsystem

7. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 7 Process oriented SIS – decomposition ( SIS subsystems and their main functions) VIII. S M S INPUTS OUTPUTS Variable analysis, Methodological audits STATISTICAL TASK X. ICT - Support DATA WAREHOUSE VII. REGISTERS System of CZSO registers  Business Registers  Natural persons database  Construction Register  Farm Register IX. DATA WAREHOUSE administration Key documents, Conception I. REQUIREMENTS Sub-system: assessment and comparison of requirements VI. DISSEMINATION Sub-system: dissemination of statistical information and data V. CENTRAL Sub-system: central processing (Modelling, imputations, calculations, quality assessment) IV. INPUT Sub-system: data collection and primary processing SP III. PROGRAMME Sub-system: processing preparation II. PREPARATION Sub-system: project preparation SUPPORT EXECUTION CONTROL P R O C E S S E S Standards International and national legislation

8. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 8 Statistical Meta-information System (SMS)

9. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 9 Meta-information component Areas covered  Statistical concepts and models  Statistical methods  Processing; production and dissemination  Users of statistical information  Assessment

10. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 10 Meta-information Component Principles  Use of SMS  obligatory  in all stages of the statistical task (ST)  Central storage and update of metadata  Unified user interface  Keeping history on the SMS objects

11. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 11 Statistical meta-information system 10 subsystems SMS Statistical Projects (Tasks) Statistical Quality Time Series Respondents Statistical CLASsifications Statistical Registers Users Dissemination Data Fund Statistical VARiables

12. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 12 SMS Subsystem QUALITY (Q-SMS)

13. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 13 Q-SMS QF Map - Inputs  Structured „Quality Formular“  view into DWH (link)  input data into DWH (manually)  It includes designed links into DWH, resp. with other SIS and SMS subsystems.  It covers items of different data formats – textual, datum, figures.  For some items classifications are defined.  Historical data stored for each run which ends by providing data out of the ST.

14. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 14 Q-SMS Aims Definition, maintenance and update of indicators and measures for statistical quality assessment.  Harmonisation  Monitoring  Assessment  Comparisons, Benchmarking  Feedback  Reporting  Support

15. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 15 Q-SMS Main References  ESS Quality Dimensions  Statistical Information Process Management (stages of ST)  Standard Quality Indicators  ONS Quality Guidelines (indicators and measures)  DESAP Checklist  Standard Quality Report

16. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 16 Q-SMS Themes Covered  Info on Statistical Process, Design, Relevance  Frame and Sample  Data sources other than surveys  Methodology  Data disclosure control  Data collection and processing  Schedule of ST  Timeliness and Punctuality  Accuracy  Accessibility and Clarity  Comparability  Coherence  Cost and Burden

17. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 17 Q-SMS Main Use of Information in Q-SMS  Management  Survey managers  Top-management  Reports  Quality reports  EFQM report  Methodology Audits  External users  Information on product quality

18. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 18 Q-SMS General Structure  Quality dimensions  Stages of statistical task  Theme  Section (i.e. sub-theme)  Item  Quantitative  Qualitative

19. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 19 Q-SMS Content Levels  Statistical task (ST)  RUN of ST processing  Relates primarily to the newest reference period  Includes all processed reference periods  Data are provided out of ST; archived in DWH clearsub-RUN  Composed of „clear“ sub-RUNs  Sub-RUN  Cover one RUN or its part  „Unclear“ sub-RUNs are deleted after RUN finishes  Statistical variable

20. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 20 Q-SMS Key Quality Indicators on Accuracy Original SW (in Oracle) for Calculation  Coefficient of Variation  Incl. for index variables  Incl. components due to sample, non- response, imputations  Response rates – Unit RR, Item RR  Imputation rates  Size of revisions

21. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 21 Q-SMS Metadata on Revisions  Type of figure  prognosis, flash estimate, expert estimate, statistical estimate, prediction  first, preliminary, revised, final  Type of revision  Current, mixed, occassional, occassional – correction  Reasons of revisions  Linked to type of revision  Current revision  Whether it was planned or considered  Next Revision of currently released data  Whether it is planned, considered or admitted, not planned

22. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 22 Q-SMS Design and Implementation Steps  Quality Indicators and Quality Reports (Phare project Quality in Statistics)  Quality measures  Design of content – structure, items (QF Map)  SW - technical proposal, development, testing, feedback and changes  Incorporation of Q-subsystem into SIS – links, parameters, testing, Q Indicators by SW  Functionality – tools for users

23. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 23 Q-SMS Outputs  Data QF Map  Across  Statistical Task(s)  Reference periods  Revisions  Changes of process features  During and after process  Definition of parameters - thresholds, limits  Ordinal variables for self-assessment

24. CZECH STATISTICAL OFFICE Na padesátém 81, CZ - 100 82 Praha 10, Czech Republic www.czso.cz 24 Thank you for your attention. jitka.prokop@czso.cz