CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 1 Subsystem QUALITY in Statistical Information System Czech Statistical Office Head of Modelling and Quality of Statistical Processing Section European Conference on Quality in Official Statistics July 2008 Jitka Prokop

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 2 Topics  Statistical Information System (SIS)  Statistical Meta-information System (SMS) Its role in the SIS  QUALITY Subsystem of SMS

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 3 Statistical Information System (SIS)

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 4 Statistical Information System (SIS) Features  Focus from quantity to quality. Indicators like CV or response rates shall have higher significance when making decisions.  Priority from survey to statistical variable – mutual relations between statistical tasks, preparation of samples is coordinated – reduction of respondent burden, increase of coherence

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 5 Statistical Information System (SIS) Frameworks, Components  Three components  Content component  Meta-information component (SMS subsystems incl. Q-subsystem)  Statistical information and technological (IT) component

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 6 Statistical Information System (SIS) Subsystems  Subsystems for particular stages of ST  Integration Tools  Meta-information System  Data Warehouse  Administrative Data Registers  ICT Support Subsystem

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 7 Process oriented SIS – decomposition ( SIS subsystems and their main functions) VIII. S M S INPUTS OUTPUTS Variable analysis, Methodological audits STATISTICAL TASK X. ICT - Support DATA WAREHOUSE VII. REGISTERS System of CZSO registers  Business Registers  Natural persons database  Construction Register  Farm Register IX. DATA WAREHOUSE administration Key documents, Conception I. REQUIREMENTS Sub-system: assessment and comparison of requirements VI. DISSEMINATION Sub-system: dissemination of statistical information and data V. CENTRAL Sub-system: central processing (Modelling, imputations, calculations, quality assessment) IV. INPUT Sub-system: data collection and primary processing SP III. PROGRAMME Sub-system: processing preparation II. PREPARATION Sub-system: project preparation SUPPORT EXECUTION CONTROL P R O C E S S E S Standards International and national legislation

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 8 Statistical Meta-information System (SMS)

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 9 Meta-information component Areas covered  Statistical concepts and models  Statistical methods  Processing; production and dissemination  Users of statistical information  Assessment

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 10 Meta-information Component Principles  Use of SMS  obligatory  in all stages of the statistical task (ST)  Central storage and update of metadata  Unified user interface  Keeping history on the SMS objects

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 11 Statistical meta-information system 10 subsystems SMS Statistical Projects (Tasks) Statistical Quality Time Series Respondents Statistical CLASsifications Statistical Registers Users Dissemination Data Fund Statistical VARiables

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 12 SMS Subsystem QUALITY (Q-SMS)

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 13 Q-SMS QF Map - Inputs  Structured „Quality Formular“  view into DWH (link)  input data into DWH (manually)  It includes designed links into DWH, resp. with other SIS and SMS subsystems.  It covers items of different data formats – textual, datum, figures.  For some items classifications are defined.  Historical data stored for each run which ends by providing data out of the ST.

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 14 Q-SMS Aims Definition, maintenance and update of indicators and measures for statistical quality assessment.  Harmonisation  Monitoring  Assessment  Comparisons, Benchmarking  Feedback  Reporting  Support

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 15 Q-SMS Main References  ESS Quality Dimensions  Statistical Information Process Management (stages of ST)  Standard Quality Indicators  ONS Quality Guidelines (indicators and measures)  DESAP Checklist  Standard Quality Report

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 16 Q-SMS Themes Covered  Info on Statistical Process, Design, Relevance  Frame and Sample  Data sources other than surveys  Methodology  Data disclosure control  Data collection and processing  Schedule of ST  Timeliness and Punctuality  Accuracy  Accessibility and Clarity  Comparability  Coherence  Cost and Burden

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 17 Q-SMS Main Use of Information in Q-SMS  Management  Survey managers  Top-management  Reports  Quality reports  EFQM report  Methodology Audits  External users  Information on product quality

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 18 Q-SMS General Structure  Quality dimensions  Stages of statistical task  Theme  Section (i.e. sub-theme)  Item  Quantitative  Qualitative

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 19 Q-SMS Content Levels  Statistical task (ST)  RUN of ST processing  Relates primarily to the newest reference period  Includes all processed reference periods  Data are provided out of ST; archived in DWH clearsub-RUN  Composed of „clear“ sub-RUNs  Sub-RUN  Cover one RUN or its part  „Unclear“ sub-RUNs are deleted after RUN finishes  Statistical variable

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 20 Q-SMS Key Quality Indicators on Accuracy Original SW (in Oracle) for Calculation  Coefficient of Variation  Incl. for index variables  Incl. components due to sample, non- response, imputations  Response rates – Unit RR, Item RR  Imputation rates  Size of revisions

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 21 Q-SMS Metadata on Revisions  Type of figure  prognosis, flash estimate, expert estimate, statistical estimate, prediction  first, preliminary, revised, final  Type of revision  Current, mixed, occassional, occassional – correction  Reasons of revisions  Linked to type of revision  Current revision  Whether it was planned or considered  Next Revision of currently released data  Whether it is planned, considered or admitted, not planned

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 22 Q-SMS Design and Implementation Steps  Quality Indicators and Quality Reports (Phare project Quality in Statistics)  Quality measures  Design of content – structure, items (QF Map)  SW - technical proposal, development, testing, feedback and changes  Incorporation of Q-subsystem into SIS – links, parameters, testing, Q Indicators by SW  Functionality – tools for users

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 23 Q-SMS Outputs  Data QF Map  Across  Statistical Task(s)  Reference periods  Revisions  Changes of process features  During and after process  Definition of parameters - thresholds, limits  Ordinal variables for self-assessment

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 24 Thank you for your attention.