Eurostat Quality Management (in the ESS context) RDG meeting of 27-28 April 2017 Jean-Pierre Poncelet - Eurostat Eurostat
Overview The Quality framework of the ESS: a self-regulatory part and a legal part The self-regulatory part: The European Statistics Code of Practice The ESS Quality Assurance Framework Recent and on-going quality related work in the ESS: Quality in the ESS Vision 2020 The High-Level Group on Quality The Quality Declaration of the ESS In Eurostat: EFQM experience
The Quality framework of the ESS: a self-regulatory part and a legal part
The quality framework of the ESS The current self-regulatory quality framework of the ESS is composed of The 4 levels (L1 - Code of Practice principle, L2 - CoP indicators, L3 - Quality Assurance Framework: methods and tools, and L-4 Domain specific quality frameworks) The general quality management principles – quality for the institutions as a whole: including leadership, partnership, staff satisfaction, continuous improvement, integration, harmonisation) This self-regulatory quality framework supplements an extensive legal framework (Treaty, R 223/2009, domain regulations,…) Both constitute the robust framework in which high- quality European statistics are developed, produced & disseminated
ES Code of Practice – aim Sets the requirements for production of European statistics Promotes the application of best international statistical practices Currently being (targeted revision)revised under the leadership of the High-Level Group Quality, e.g.: Generalisation (- survey) and modernisation (e.g. paper publication, value), including alignment to R 223 (e.g. Admin data) Coordination / cooperation
ES Code of Practice – Stucture Quality is defined by the ES Code of Practice in terms of the Set-up of the institutional environment (6 principles). RDG: P3 Adequacy of resources Statistical processes (4 principles). RDG: P9 response burden, P10 cost effectiveness, Statistical outputs (5 principles). RDG: P11 Relevance / work programme
Quality Assurance Framework (QAF) of the ESS Applicable across all statistical domains Provides methods and tools at institutional and process level Contains also links to relevant reference documentation
Code of Practice Principle 4 Commitment to Quality: Statistical authorities are committed to quality. They systematically and regularly identify strengths and weaknesses to continuously improve process and product quality.
ES Code of Practice – monitoring National and Eurostat self-assessments in 2005 http://epp.eurostat.ec.europa.eu/portal/page/portal/quality/code_of_practice/ess_system_compliance ESS peer reviews in 2006-2008 (1st round) http://epp.eurostat.ec.europa.eu/portal/page/portal/quality/code_of_practice/peer_reviews Annual monitoring and reporting of improvement actions (Eurostat & ESGAB) 2nd round of self-assessments and ESS peer reviews in 2013-2015 http://ec.europa.eu/eurostat/web/quality/peer-reviews
ESS Vision 2020 Key Area 2 Quality of European statistics: We will provide high quality products and services that meet user needs. We value quality not only for our core products and processes, but also for our institutions as a whole, for overall management, organisation, and governance. Our strong emphasis on quality remains a pre-condition for maintaining public trust in official statistics. This is one of our key assets and comparative advantages in a world experiencing a growing trend of instant information which often lacks the necessary “proof of quality”. We manifest ourselves as the statistical conscience, which guides society through the information overload.
QUAL@ESS Vision 2020 Coordinate quality in the ESS Vision 2020 Portfolio Ensure continuous fit-for-purpose quality in line with stakeholders' expectations Develop the conceptual elements of quality for institutions as a whole Work in close cooperation with colleagues in the ESS: High Level Group Quality, Steering Committee QUAL and Working Group Quality (DIME / IT DG) Eurostat
ESS high-level group on quality Mandated in 2016 by the ESS Committee with the participation of 10 Directors General and Eurostat Provide guidance on strategic quality issues: ESS Quality Declaration approved in September 2016 Modernisation of the quality framework of the ESS (CoP review, its future monitoring and quality for institutions as a whole) Improved communication of quality profiles to users, better interaction with stakeholders Strengths and weaknesses, possible improvements of European statistics within the quality dimensions Eurostat
The Quality declaration of the ESS Adopted by the ESSC in September 2016 Commitment to statistical excellence Systematic identification of strengths, weaknesses and risks Continuous innovation and modernisation Anticipate emerging phenomena and needs with our users
Why a strategic management framework needed in the ESS context? Principle 4 of the Code: Commitment to Quality Key area 2 of the ESS Vision 2020 Quality declaration of the ESS
In Eurostat: EFQM experience European Foundation for Quality Management Assessment of the quality of the organisation as a whole strategic management tool Journey to excellence assessment in October 2016 Result: Committed to Excellence – 2 stars Eurostat
Value of a strategic management tool? Enabling organisations to understand their key strengths and potential areas of improvement to achieve their vision and mission Providing a common vocabulary and way of thinking about the organisation, facilitating communication
Value of a strategic management tool? Integrating existing and planned activities, removing duplications and identifying gaps Providing a basic infrastructure for the organisation's management system
Strengths identified Senior management, visible and approachable, leading EFQM implementation Awareness and response to changes in the operating environment Objectives cascaded down to all staff Eurostat Staff Opinion Survey carried out every two years, results analysed and concrete actions taken artnerships with major stakeholders (especially with NSIs) managed in a structured way Segmentation of users to better understand and meet their needs and carrying out of user satisfaction surveys Development of KPIs, benchmarking and linking to strategy
Strengths identified Partnerships with major stakeholders (especially with NSIs) managed in a structured way Segmentation of users to better understand and meet their needs and carrying out of user satisfaction surveys Development of KPIs, linking to strategy
Areas for future attention Comparison of key business results (benchmarking) with organisations external to the Commission Lessons learned from projects Keep adequate number of staff with relevant skills to face upcoming challenges Corporate social responsibility Volume of information
Benefits over the last 2 years Enabler map: key business approaches to fulfil our mission Bring colleagues together ("horizontal / production", spread knowledge and enthusiasm about Eurostat Mission, vision and values discussed with staff Process management, Quality Reviews, DIGICOM
Management of Quality / Quality of management Quality of products / quality of organisations Thank you for your attention! Do you have questions or comments? Eurostat