Assessment of Quality in Statistics GLOBAL ASSESSMENTS, PEER REVIEWS AND SECTOR REVIEWS IN THE ENLARGEMENT AND ENP COUNTRIES Mirela Kadic, Project Manager at Statistics Department, ICON Institute Sarajevo, 8 October 2018

Introduction There are many tools available for national authorities and development partners to use to assess the capacity of national statistical systems in order to focus improvement efforts. Type A. Tools used by national authorities to inform national statistical planning/strategies (NSDSs) Type B. Tools for development partners who want to “invest” in statistics to inform project design and monitoring Type C. Tools for monitoring statistical performance internationally Type D. Tools to assess quality and/or compliance with statistical codes of practice

Overview The European statistics Code of Practice (CoP) sets the standards for developing, producing and disseminating European statistics for all members of the European statistical system (ESS). ESS’s quality assurance framework (QAF) describes the tools and procedures put in place to ensure that statistics that are produced are of high quality. It serves as guidance on how to implement the CoP. Assessments form the essential elements of evaluation within the overall quality assurance framework.

What are Global Assessments? Broad strategic reviews of statistical systems, covering: - Institutional environment - Engagement with users and also respondents - Practice in individual statistical domains - Whether resources are efficiently used, and well directed Main objective : To evaluate the level of conformity with European and international standards, incorporating: -the European statistics Code of Practice, -the UN Fundamental Principles of Official Statistics -the Eurostat Statistical Requirements Compendium.

Why should GA be done? GA intends to obtain the picture of the current health of official statistics in a country, in order to: Better direct system strengthening efforts Assess quality of process compared to international standards in selected domains Support the NSI in strengthening its position and coordinating role in the NSS Promote official statistics and the need for good quality statistics in the country A way to strengthen culture of continuous quality assessment in your country

How the GA is done? A GA is not imposed on a country. It is only done at the request of the NSI of the country. Expert selection. Flexible and highly consultative approach, external experts are selected in agreement with the country SAQ – country completes a self-assessment questionnaire and provides key documents Mission 1. First expert mission clarifying and preparing a first draft report Revision of the report by the expert team, NSI and Eurostat Mission 2. Consolidating info and agreeing on the recommendations Final report published Annual monitoring of the implementation of the recommendations -

What are PRs and why do them? Qualitative assessments of how compliant a country's statistical system is with the European Statistics Code of Practice. Focus on the national statistical authority plus some selected other national statistical authorities (ONAs) To assess compliance of the reviewed national statistical authority and some other national statistical authorities (ONAs) with respect to all Principles of the Code of Practice To evaluate the coordination role of the national statistical authority within the statistical system; To highlight transferable practices suitable to foster compliance with the Code of Practice; To recommend actions needed to comply fully with the CoP

How PRs are conducted? They are conducted upon request from a country. SAQ. Used also for ONAs (audit like approach: answers supported with suitable evidence) Experts. A team of independent experts ( statisticians ) conduct the review Single mission The report. Structured around issues - governance, efficiency, impact and contains recommendations The improvement actions are formulated by the national statistical authorities.

What are SRs and why do them? Detailed analysis of the statistical production processes in specific sectors Specifically tailored to countries that aim to align important sectors of statistics with European standards. Sector reviews: Why do them? To assess the administrative and technical capacity of the reviewed statistical systems to produce statistics in the sector concerned; To assess the statistical production in the relevant sector; To assess the statistical production against the EU acquis; To review the medium and long-term planning within the sector;

RESULTS GA: A comprehensive overview of the NSS A set of recommendations Some proposals for possible improvement actions that could be considered Peer reviews: An evaluation of the compliance with the CoP a set of recommendations, followed by improvement actions proposed by NSIs, the implementation of which is followed up and monitored Sector reviews: A detail analysis of a statistical sector a list of recommendations to be undertaken in order to improve the data delivery and functioning of the sector under review

What to do with the results? Some ideas to use the results: Develop a picture of areas most in need of improvement Use final report as a basis for internal reflection on improvement actions and monitoring of improvement actions Changes to resource use (human and financial) how resources are aligned to priority statistical tasks ; Changes to working arrangements internally and with key partners.

Summary GA PR SR Institutional coverage National Statistical System Focus on National Statistical Institute and some ONAs in the context of the NSS NSI and other producers involved in the statistical sector Topics covered Horizontal topics, statistical infrastructure (classifications, etc.) and some sector statistics Only horizontal topics (legislation, human resources, IT, governance) Statistical production processes in specific sectors in detail

Summary (cont.) GA PR SR Self-assessment questionnaires Are not systematically used Formal part of the process Tailored to the needs of the statistical institute and to the statistical sector under review Main purpose Strategic orientation and re-design of statistical system. Basis for multi-annual programmes. Plan the assistance by donors Benchmarking against other members of the ESS and identification of best practices Align important sectors of statistics with European standards

Some GA, PR and SR implemented by ICON, ENP countries

Thank you for your attention! mirela.kadic@icon-institute.de