21 June 2011 High level seminar for EECCA on “Quality matters in statistics” High level seminar for EECCA on “Quality matters in statistics” The Code of Practice as a framework for ESS quality Claudia Junker Head of Unit D1 « Statistical cooperation with European and Mediterranean countries »

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 2 Agenda Background of the European Statistics CoP (why, when) Role and content of the European Statistics CoP –15 principles –77 indicators Implementation of the European Statistics CoP –Self-assessments and peer reviews –Lessons learned –ESS good practices –ESGAB Future of the European Statistics CoP A Quality framework

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 3 Background of the CoP (1) June 2004: invitation to develop minimum European standards on the independence, integrity and accountability of NSIs 3 lines of action: - Code of Practice - amending Regulation 3605/93 on the quality of statistical data in the Excessive Deficit Procedure context - Reinforcement of operational capacity of Eurostat for dealing with fiscal statistics February 2005: adoption of the Code by the Member States based on the proposal of its Task Force 25 May 2005: Communication and a Recommendation on the independence, integrity and accountability of the national and Community statistical authorities including the CoP March 2009: establishment of ESGAB

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 4 Background of the CoP (2) Self-regulatory instrument (taking the form of a Recommendation ) – why? Benefits of the CoP: –Cohesion of a statistical system –Promotion of common values –Improve (self-) image and reputation –Guidelines for integrating staff members –Creating a climate of integrity and excellence Dual purpose of the CoP: –To improve trust and confidence –To reinforce quality of statistics Largely mirrors the UN fundamental principles

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 5 Role and content of the CoP (1) 3 headings –Institutional environment –Statistical processes –Statistical output 15 principles 77 indicators to measure how the principles are applied

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 6 Role and content of the CoP (2) 15 Principles covering: Institutional environment - Professional independence, Mandate for data collection, Adequacy of resources, Quality commitment, Statistical confidentiality, Impartiality and objectivity Statistical processes - Sound methodology, Appropriate statistical procedures, Non-excessive burden on respondents, Cost effectiveness Statistical outputs - Relevance, Accuracy and reliability, Timeliness and punctuality, Coherence and comparability, Accessibility and clarity

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 7 Role and content of the CoP (3) Indicators – examples: Professional independence: –The independence of the statistical authority from political and other external interference in producing and disseminating official statistics is specified in law –The head of the statistical authority…has the sole responsibility for deciding on statistical methods, standards and procedures and on the content and timing of statistical releases. – The statistical work programmes are published and periodic reports describe progress made. Quality commitment: – Product quality is regularly monitored according to the ESS quality components. – Processes are in place to monitor the quality of the collection, processing and dissemination of statistics. – Quality guidelines are documented and staff are well trained. These guidelines are spelled out in writing and made known to the public.

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 8 Role and content of the CoP (4) Statistical confidentiality: – Statistical confidentiality is guaranteed in law. – Instructions and guidelines are provided on the protection of statistical confidentiality in the production and dissemination processes. These guidelines are spelled out in writing and made known to the public. –Strict protocols apply to external users accessing statistical micro-data for research purposes. Cost effectiveness – Internal and independent external measures monitor the statistical authority’s use of resources – Proactive efforts are being made to improve the potential of administrative records and avoid costly direct surveys. Accessibility and clarity: – Statistics are presented in a form that facilitates proper interpretation and meaningful comparison. – Dissemination services use modern information and communication technology and, if appropriate, traditional hard copy. – Metadata are documented according to the methodology of statistical processes and the quality of statistical output with respect to the ESS quality criteria.

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 9 Implementation of the CoP (1) Task force with Eurostat and Member States Ownership by Member States Self-assessments Peer reviews Protocols for selected areas Lessons learned ESS wide good practices ESGAB

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 10 Implementation of the CoP (2) Self-assessments 2005 Self-assessments (standard questionnaire) Detailed questions for each indicator Strengths / weaknesses Improvement actions

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 11 Implementation of the CoP (3) Self-assessments Results of self-assessments

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 12 Implementation of the CoP (4) Self-assessments

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 13 Implementation of the CoP (5) Self-assessments

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 14 Implementation of the CoP (6) Peer reviews ESS wide peer reviews in Objectives –monitoring of the implementation of the Code of Practice –to boost quality, to enhance credibility –identification of ESS benchmarks and common difficulties –sharing of ESS best practices and knowledge transfer Scope –27 EU MS + 4 EFTA MS + Eurostat –institutional environment and dissemination practices –co-ordination role of NSI Mechanics fully met /largely met/ partly met /not met –common guidelines and assessment basis fully met /largely met/ partly met /not met –2 ½ days, 3 peers, information package, meetings with various stakeholders Transparency –All reports available on Eurostat website

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 15 Implementation of the CoP (7) Peer reviews – ESS results Results

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 16 Implementation of the CoP (8) Peer reviews – ESS results

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 17 Implementation of the CoP (9) Peer reviews – ESTAT results

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 18 Implementation of the CoP (10) Peer reviews – ESTAT results

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 19 Implementation of the CoP (11) Peer reviews - Lessons learned Successful exercise, benefits going beyond the objectives Adequate scope – domain specific reviews? Further evolution of the CoP needed More limited number of peer reviewers would be beneficial More guidance on good practices needed Extended stay of peer reviewers useful? Objectivity of the reviews? Investment versus output?

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 20 Implementation of the CoP (12) ESS good practices One of the objectives! Statistical law covering all actors at national level Mobility policy within the office and with other producers Work programme covering all official statistics common dissemination platform Reorganisation of offices with transfer of responsibilities to regional offices labelling/certification mechanism Document available on Eurostat’s website

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 21. ESGAB – purpose and main tasks Implementation of the CoP by Eurostat Advice on measures to facilitate implementation of the CoP in Eurostat ESS as a whole: Implementation of the CoP by ESS as a whole Advice on measures to to facilitate ESS implementation of the CoP annual report advise Eurostat on communicating the Code to users and data providers advise Eurostat and the ESS Committee as regards updating the Code. Purpose:to provide an independent overview of the ESS implementation of the CoP

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 22 Future of the CoP Sponsorship group on quality – review of the indicators Discussion among the Member States Main principles: –Keep it stable (better comparability) –Adapt to new circumstances Changes in indicators Changes in preamble Better reflection on use of administrative data sources Additional indicator on professional independence Additional indicators on quality management

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 23 A quality assurance framework Estat QAF User needs Statistical outputs Production processes Institutional environment Management systems and leadership Support processes Quality Assurance Framework Total Quality Management

21 June 2011 High level seminar for EECCA on “Quality matters in statistics” 24 Thank you for your attention!