Introduction to Quality Management Frameworks Eurostat, Luxembourg, 25-26 January 2016 Process quality Dr Johanna Laiho-Kauranne.

Slides:



Advertisements
Similar presentations
SN BA Project - Business Activity Model
Advertisements

Enhancing Data Quality of Distributive Trade Statistics Workshop for African countries on the Implementation of International Recommendations for Distributive.
Workshop on Energy Statistics, China September 2012 Data Quality Assurance and Data Dissemination 1.
The quality framework of European statistics by the ESCB Quality Conference Vienna, 3 June 2014 Aurel Schubert 1) European Central Bank 1) This presentation.
TURKISH STATISTICAL INSTITUTE Metadata and Standards Department 1 Nezihat KERET Gülhan Eminkahyagil Metadata and Standards Department Turkish Statistical.
South Africa System of data collection and dissemination of manufacturing statistics May 2009 The preferred supplier of quality statistics.
4. Quality Management System (QMS)
4. Quality Management System (QMS)
United Nations Economic Commission for Europe Statistical Division Applying the GSBPM to Business Register Management Steven Vale UNECE
Internal Auditing and Outsourcing
The use and convergence of quality assurance frameworks for international and supranational organisations compiling statistics The European Conference.
Bernadett Szekeres Quality management, Methodology Department, HCSO
M ETADATA OF NATIONAL STATISTICAL OFFICES B ELARUS, R USSIA AND K AZAKHSTAN Miroslava Brchanova, Moscow, October, 2014.
Quality assurance activities at EUROSTAT CCSA Conference Helsinki, 6-7 May 2010 Martina Hahn, Eurostat.
Marina Signore Head of Service “Audit for Quality Istat Assessing Quality through Auditing and Self-Assessment Signore M., Carbini R., D’Orazio M., Brancato.
Development of metadata in the National Statistical Institute of Spain Work Session on Statistical Metadata Genève, 6-8 May-2013 Ana Isabel Sánchez-Luengo.
The Adoption of METIS GSBPM in Statistics Denmark.
Quality Assessments of Statistical Production Processes in Eurostat Pierre Ecochard and Małgorzata Szczęsna
United Nations Economic Commission for Europe Statistical Division Introducing the GSBPM Steven Vale UNECE
Eurostat Overall design. Presented by Eva Elvers Statistics Sweden.
Support for design of statistical surveys at Statistics Sweden
CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 1 Subsystem QUALITY in Statistical Information System Czech.
1 MODERNIZATION OF BELARUSIAN STATISTICS _________________________________________________ IMPLEMENTATION OF THE PROCESS APPROACH IN ORGANIZING THE STATISTICAL.
Current and Future Applications of the Generic Statistical Business Process Model at Statistics Canada Laurie Reedman and Claude Julien May 5, 2010.
United Nations Economic Commission for Europe Statistical Division Mapping Data Production Processes to the GSBPM Steven Vale UNECE
United Nations Economic Commission for Europe Statistical Division High-Level Group Achievements and Plans Steven Vale UNECE
1 C. ARRIBAS, D. LORCA, A. SALINERO & A. COLMENERO Measuring statistical quality at the Spanish National Statistical Institute.
Copyright 2010, The World Bank Group. All Rights Reserved. Principles, criteria and methods Part 2 Quality management Produced in Collaboration between.
Implementation of the European Statistics Code of Practice Yalta September 2009 Pieter Everaers, Eurostat.
Pilot Census in Poland Some Quality Aspects Geneva, 7-9 July 2010 Janusz Dygaszewicz Central Statistical Office POLAND.
Developing and applying business process models in practice Statistics Norway Jenny Linnerud and Anne Gro Hustoft.
SDMX IT Tools Introduction
United Nations Oslo City Group on Energy Statistics OG7, Helsinki, Finland October 2012 ESCM Chapter 8: Data Quality and Meta Data 1.
Recent development in the metadata area at Statistics Sweden Klas Blomqvist
Sponsorship on Quality The final report Zsuzsanna Kovács Expert Group Meeting on National Quality Assurance Frameworks UNSD, New York, September.
GSIM, DDI & Standards- based Modernisation of Official Statistics Workshop – DDI Lifecycle: Looking Forward October 2012.
5.8 Finalise data files 5.6 Calculate weights Price index for legal services Quality Management / Metadata Management Specify Needs Design Build CollectProcessAnalyse.
METIS 2011 Workshop Session III – National Implementation of the GSBPM Alice Born and Tim Dunstan Thursday October 6, 2011 Implementation of the GSBPM.
13 November, 2014 Seminar on Quality Reports QUALITY REPORTS EXPERIENCE OF STATISTICS LITHUANIA Nadiežda Alejeva Head, Price Statistics.
Statistical process model Workshop in Ukraine October 2015 Karin Blix Quality coordinator
United Nations Economic Commission for Europe Statistical Division GSBPM in Documentation, Metadata and Quality Management Steven Vale UNECE
1 Recent developments in quality related matters in the ESS High level seminar for Eastern Europe, Caucasus and Central Asia countries Claudia Junker,
COBIT. The Control Objectives for Information and related Technology (COBIT) A set of best practices (framework) for information technology (IT) management.
Maria João Zilhão Planning and Quality Control Unit « High Level Seminar “Quality Matters in Statistics” June, Athens, Greece Implementation of the.
4–6 September 2013, Vilnius, Lithuania High-Level Seminar for Eastern Europe, Caucasus and Central Asia Countries QUALITY FRAMEWORK AT.
Introduction to Statistics Estonia Study visit of the State Statistical Service of Ukraine on Dissemination of Statistical Information and related themes.
United Nations Economic Commission for Europe Statistical Division CSPA: The Future of Statistical Production Steven Vale UNECE
Investment Intentions Survey 2016
UNECE-CES Work session on Statistical Data Editing
Implementation of Quality indicators for administrative data
Integrated Management System and Certification
Documentation of statistics
Generic Statistical Business Process Model (GSBPM)
Overview of the ESS quality framework and context
Tomaž Špeh, Rudi Seljak Statistical Office of the Republic of Slovenia
Metadata in the modernization of statistical production at Statistics Canada Carmen Greenough June 2, 2014.
Scanning the environment: The global perspective on the integration of non-traditional data sources, administrative data and geospatial information Sub-regional.
CSPA: The Future of Statistical Production
The European Statistics Code of Practice - a Basis for Eurostat’s Quality Assurance Framework Marie Bohatá Deputy Director General, Eurostat ... Strategic.
Using the GSBPM in Practice
Mapping Data Production Processes to the GSBPM
Metadata used throughout statistics production
Karin Blix, Statistics Denmark,
GSBPM AND ISO AS QUALITY MANAGEMENT SYSTEM TOOLS: AZERBAIJAN EXPERIENCE Yusif Yusifov, Deputy Chairman of the State Statistical Committee of the Republic.
Metadata on quality of statistical information
Overview of the ESS quality framework and context
GSBPM Giorgia Simeoni, Istat,
Lecture 1: Definition of quality in statistics
Presentation transcript:

Introduction to Quality Management Frameworks Eurostat, Luxembourg, January 2016 Process quality Dr Johanna Laiho-Kauranne

Structure of the lecture I.Identification and specification of processes II.Process description III.Process performance IV.Implementation of Generic Business Process Model (GSBPM) 2

I. Identification and specification of processes

Typology of statistical process I.Sample survey II.Census III.Statistical process using administrative source(s) IV.Statistical process involving multiple data sources V.Price or other economic index process VI.Statistical compilation 4

Definition of public process 5 Process is any activity (set of activities) that uses resources to transform inputs to outputs in the regulated environment with given resources OUTputs Regulations Resources INputs PROCESS Source: Mária Dologová, SOSR

Definition of public process approach 6 S ystematic identification and management of the processes in the organisation and particularly of the interactions between these processes Customers (external, internal) or interested parties generally = the key (their role in input, output) OUTputs Regulations Resources INputs PROCESS Source Mária Dologová, SOSR Requirements Specified Requirements Satisfiied

Quality frameworks - processes EFQM: Criterion 5 - Processes, Products & Services how organisation designs, manages and improves its processes, products and services to generate increasing value for customers and other stakeholders. QMS ISO 9001: The organisation shall: identify the processes needed for the QMS; determine the sequence and interaction of these processes; determine criteria and methods needed to ensure that both the operation and control of these processes are effective; ensure the availability of resources and information necessary to support the operation and monitoring of these processes; monitor, measure and analyse these processes; implement actions necessary to achieve planned results and continual improvement of these processes. 7 Horizontal management

CoP & QAF on Statistical processes P7 – Sound Methodology P8 – Appropriate Statistical Procedures P9 – Non-excessive Burden on Respondents P10 – Cost effectiveness 8 Compare with ISO 9001:2008 definitions on processes: Effectiveness of process = Ability to achieve desired results Efficiency of process = Results achieved vs resources used

9

Benefits of processes (ISO 9000) Integration and alignment of processes to enable achievement of desired outcomes Ability to focus effort on process effectiveness and efficiency Provision of confidence to customers and other interested parties, about the consistent performance of the organization Transparency of operations within the organisation Lower costs and creation of shorter cycle times, through the effective use of resources Improved, consistent and predictable results Provision of opportunities for focused and prioritized improvement initiatives Encouragement of the involvement of people and the clarification of their responsibilities 10

CoP – Components influencing process quality 11 Process efficiency, effectiveness Institutional environment ES CoP Non-excessive burden on respondents Cost effectiveness Appropriate stat. procedures Sound methodology Output Quality Statistical processes

II. Process Description

Describing a process – how to start? 13 Choose the quality framework ESS-QAF ISO DESAP GSBPM Follow the detailed manual and gradually build- up systematic updated documentation Manage the process while managing the performance Target setting and monitoring

Describing a process 14

IV. Implementation of Generic Statistical Business Process Model (GSBPM)

Quality Management / Metadata Management 1 Specify Needs 1 Specify Needs 2 Design 2 Design 3 Build 3 Build 4 Collect 4 Collect 5 Process 5 Process 6 Analyse 6 Analyse 7 Disseminate 7 Disseminate 8 Archive 8 Archive 1.1 Determine need for information 1.1 Determine need for information 1.2 Consult and confirm need 1.2 Consult and confirm need 1.3 Establish output objectives 1.3 Establish output objectives 1.5 Check data availability 1.5 Check data availability 1.6 Prepare business case 1.6 Prepare business case 2.1 Design outputs 2.1 Design outputs 2.2 Design variable descriptions 2.2 Design variable descriptions 2.4 Design frame and sample methodology 2.4 Design frame and sample methodology 2.5 Design statistical processing methodology 2.5 Design statistical processing methodology 2.6 Design production system and workflow 2.6 Design production system and workflow 4.1 Select sample 4.1 Select sample 4.2 Set up collection 4.2 Set up collection 4.3 Run collection 4.3 Run collection 4.4 Finalize collection 4.4 Finalize collection 5.1 Integrate data 5.1 Integrate data 5.2 Classify and code 5.2 Classify and code 5.3 Review, validate and edit 5.3 Review, validate and edit 5.5 Derive new variables and statistical units 5.5 Derive new variables and statistical units 5.7 Calculate aggregates 5.7 Calculate aggregates 6.1 Prepare draft outputs 6.1 Prepare draft outputs 6.2 Validate outputs 6.2 Validate outputs 6.3 Scrutinize and explain 6.3 Scrutinize and explain 6.4 Apply disclosure control 6.4 Apply disclosure control 6.5 Finalize outputs 6.5 Finalize outputs 7.1 Update output systems 7.1 Update output systems 7.2 Produce dissemination products 7.2 Produce dissemination products 7.3 Manage release of dissemination products 7.3 Manage release of dissemination products 7.5 Manage user queries 7.5 Manage user queries 7.4 Promote dissemination products 7.4 Promote dissemination products 8.1 Define archive rules 8.1 Define archive rules 8.2 Manage archive repository 8.2 Manage archive repository 8.3 Preserve data and associated metadata 8.3 Preserve data and associated metadata 8.4 Dispose of data and associated metadata 8.4 Dispose of data and associated metadata 5.6 Calculate weights 5.6 Calculate weights 2.3 Design data collection methodology 2.3 Design data collection methodology 9 Evaluate 9 Evaluate 9.1 Gather evaluation inputs 9.1 Gather evaluation inputs 9.2 Conduct evaluation 9.2 Conduct evaluation 9.3 Agree action plan 9.3 Agree action plan GSBPM: Sub-processes with interest group contacts 1.4 Identify concepts 1.4 Identify concepts 3.6 Finalize production systems 3.6 Finalize production systems 3.5 Test statistical business process 3.5 Test statistical business process 3.2 Build or enhance process components 3.2 Build or enhance process components 3.3 Configure workflows 3.3 Configure workflows 3.4 Test production system 3.4 Test production system 3.1 Build data collection instrument 3.1 Build data collection instrument 5.4 Impute 5.4 Impute 5.8 Finalize data files 5.8 Finalize data files 16 Main Consult with users needs Consult with research Process owner / revised; original UNECE / Steven Vale GSBPM: Sub-processes with interest group contacts

Quality Management / Metadata Management 1 Specify Needs 1 Specify Needs 2 Design 2 Design 3 Build 3 Build 4 Collect 4 Collect 5 Process 5 Process 6 Analyse 6 Analyse 7 Disseminate 7 Disseminate 8 Archive 8 Archive 1.1 Determine need for information 1.1 Determine need for information 1.2 Consult and confirm need 1.2 Consult and confirm need 1.3 Establish output objectives 1.3 Establish output objectives 1.5 Check data availability 1.5 Check data availability 1.6 Prepare business case 1.6 Prepare business case 2.1 Design outputs 2.1 Design outputs 2.2 Design variable descriptions 2.2 Design variable descriptions 2.4 Design frame and sample methodology 2.4 Design frame and sample methodology 2.5 Design statistical processing methodology 2.5 Design statistical processing methodology 2.6 Design production system and workflow 2.6 Design production system and workflow 4.1 Select sample 4.1 Select sample 4.2 Set up collection 4.2 Set up collection 4.3 Run collection 4.3 Run collection 4.4 Finalize collection 4.4 Finalize collection 5.1 Integrate data 5.1 Integrate data 5.2 Classify and code 5.2 Classify and code 5.3 Review, validate and edit 5.3 Review, validate and edit 5.5 Derive new variables and statistical units 5.5 Derive new variables and statistical units 5.7 Calculate aggregates 5.7 Calculate aggregates 6.1 Prepare draft outputs 6.1 Prepare draft outputs 6.2 Validate outputs 6.2 Validate outputs 6.3 Scrutinize and explain 6.3 Scrutinize and explain 6.4 Apply disclosure control 6.4 Apply disclosure control 6.5 Finalize outputs 6.5 Finalize outputs 7.1 Update output systems 7.1 Update output systems 7.2 Produce dissemination products 7.2 Produce dissemination products 7.3 Manage release of dissemination products 7.3 Manage release of dissemination products 7.5 Manage user queries 7.5 Manage user queries 7.4 Promote dissemination products 7.4 Promote dissemination products 8.1 Define archive rules 8.1 Define archive rules 8.2 Manage archive repository 8.2 Manage archive repository 8.3 Preserve data and associated metadata 8.3 Preserve data and associated metadata 8.4 Dispose of data and associated metadata 8.4 Dispose of data and associated metadata 5.6 Calculate weights 5.6 Calculate weights 2.3 Design data collection methodology 2.3 Design data collection methodology 9 Evaluate 9 Evaluate 9.1 Gather evaluation inputs 9.1 Gather evaluation inputs 9.2 Conduct evaluation 9.2 Conduct evaluation 9.3 Agree action plan 9.3 Agree action plan GSBPM: Sub-processes with interest group contacts 1.4 Identify concepts 1.4 Identify concepts 3.6 Finalize production systems 3.6 Finalize production systems 3.5 Test statistical business process 3.5 Test statistical business process 3.2 Build or enhance process components 3.2 Build or enhance process components 3.3 Configure workflows 3.3 Configure workflows 3.4 Test production system 3.4 Test production system 3.1 Build data collection instrument 3.1 Build data collection instrument 5.4 Impute 5.4 Impute 5.8 Finalize data files 5.8 Finalize data files 17 Main Consult with users needs Consult with research Process owner / revised; original UNECE / Steven Vale RELE- VANCE GSBPM: Sub-processes with interest group contacts

Quality Management / Metadata Management 1 Specify Needs 1 Specify Needs 2 Design 2 Design 3 Build 3 Build 4 Collect 4 Collect 5 Process 5 Process 6 Analyse 6 Analyse 7 Disseminate 7 Disseminate 8 Archive 8 Archive 1.1 Determine need for information 1.1 Determine need for information 1.2 Consult and confirm need 1.2 Consult and confirm need 1.3 Establish output objectives 1.3 Establish output objectives 1.5 Check data availability 1.5 Check data availability 1.6 Prepare business case 1.6 Prepare business case 2.1 Design outputs 2.1 Design outputs 2.2 Design variable descriptions 2.2 Design variable descriptions 2.4 Design frame and sample methodology 2.4 Design frame and sample methodology 2.5 Design statistical processing methodology 2.5 Design statistical processing methodology 2.6 Design production system and workflow 2.6 Design production system and workflow 4.1 Select sample 4.1 Select sample 4.2 Set up collection 4.2 Set up collection 4.3 Run collection 4.3 Run collection 4.4 Finalize collection 4.4 Finalize collection 5.1 Integrate data 5.1 Integrate data 5.2 Classify and code 5.2 Classify and code 5.3 Review, validate and edit 5.3 Review, validate and edit 5.5 Derive new variables and statistical units 5.5 Derive new variables and statistical units 5.7 Calculate aggregates 5.7 Calculate aggregates 6.1 Prepare draft outputs 6.1 Prepare draft outputs 6.2 Validate outputs 6.2 Validate outputs 6.3 Scrutinize and explain 6.3 Scrutinize and explain 6.4 Apply disclosure control 6.4 Apply disclosure control 6.5 Finalize outputs 6.5 Finalize outputs 7.1 Update output systems 7.1 Update output systems 7.2 Produce dissemination products 7.2 Produce dissemination products 7.3 Manage release of dissemination products 7.3 Manage release of dissemination products 7.5 Manage user queries 7.5 Manage user queries 7.4 Promote dissemination products 7.4 Promote dissemination products 8.1 Define archive rules 8.1 Define archive rules 8.2 Manage archive repository 8.2 Manage archive repository 8.3 Preserve data and associated metadata 8.3 Preserve data and associated metadata 8.4 Dispose of data and associated metadata 8.4 Dispose of data and associated metadata 5.6 Calculate weights 5.6 Calculate weights 2.3 Design data collection methodology 2.3 Design data collection methodology 9 Evaluate 9 Evaluate 9.1 Gather evaluation inputs 9.1 Gather evaluation inputs 9.2 Conduct evaluation 9.2 Conduct evaluation 9.3 Agree action plan 9.3 Agree action plan GSBPM: Sub-processes with interest group contacts 1.4 Identify concepts 1.4 Identify concepts 3.6 Finalize production systems 3.6 Finalize production systems 3.5 Test statistical business process 3.5 Test statistical business process 3.2 Build or enhance process components 3.2 Build or enhance process components 3.3 Configure workflows 3.3 Configure workflows 3.4 Test production system 3.4 Test production system 3.1 Build data collection instrument 3.1 Build data collection instrument 5.4 Impute 5.4 Impute 5.8 Finalize data files 5.8 Finalize data files 18 Main Consult with users needs Consult with research Process owner / revised; original UNECE / Steven Vale ACCURACY And RELIABILITY ACCURACY And RELIABILITY GSBPM: Sub-processes with interest group contacts

Quality Management / Metadata Management 1 Specify Needs 1 Specify Needs 2 Design 2 Design 3 Build 3 Build 4 Collect 4 Collect 5 Process 5 Process 6 Analyse 6 Analyse 7 Disseminate 7 Disseminate 8 Archive 8 Archive 1.1 Determine need for information 1.1 Determine need for information 1.2 Consult and confirm need 1.2 Consult and confirm need 1.3 Establish output objectives 1.3 Establish output objectives 1.5 Check data availability 1.5 Check data availability 1.6 Prepare business case 1.6 Prepare business case 2.1 Design outputs 2.1 Design outputs 2.2 Design variable descriptions 2.2 Design variable descriptions 2.4 Design frame and sample methodology 2.4 Design frame and sample methodology 2.5 Design statistical processing methodology 2.5 Design statistical processing methodology 2.6 Design production system and workflow 2.6 Design production system and workflow 4.1 Select sample 4.1 Select sample 4.2 Set up collection 4.2 Set up collection 4.3 Run collection 4.3 Run collection 4.4 Finalize collection 4.4 Finalize collection 5.1 Integrate data 5.1 Integrate data 5.2 Classify and code 5.2 Classify and code 5.3 Review, validate and edit 5.3 Review, validate and edit 5.5 Derive new variables and statistical units 5.5 Derive new variables and statistical units 5.7 Calculate aggregates 5.7 Calculate aggregates 6.1 Prepare draft outputs 6.1 Prepare draft outputs 6.2 Validate outputs 6.2 Validate outputs 6.3 Scrutinize and explain 6.3 Scrutinize and explain 6.4 Apply disclosure control 6.4 Apply disclosure control 6.5 Finalize outputs 6.5 Finalize outputs 7.1 Update output systems 7.1 Update output systems 7.2 Produce dissemination products 7.2 Produce dissemination products 7.3 Manage release of dissemination products 7.3 Manage release of dissemination products 7.5 Manage user queries 7.5 Manage user queries 7.4 Promote dissemination products 7.4 Promote dissemination products 8.1 Define archive rules 8.1 Define archive rules 8.2 Manage archive repository 8.2 Manage archive repository 8.3 Preserve data and associated metadata 8.3 Preserve data and associated metadata 8.4 Dispose of data and associated metadata 8.4 Dispose of data and associated metadata 5.6 Calculate weights 5.6 Calculate weights 2.3 Design data collection methodology 2.3 Design data collection methodology 9 Evaluate 9 Evaluate 9.1 Gather evaluation inputs 9.1 Gather evaluation inputs 9.2 Conduct evaluation 9.2 Conduct evaluation 9.3 Agree action plan 9.3 Agree action plan GSBPM: Sub-processes with interest group contacts 1.4 Identify concepts 1.4 Identify concepts 3.6 Finalize production systems 3.6 Finalize production systems 3.5 Test statistical business process 3.5 Test statistical business process 3.2 Build or enhance process components 3.2 Build or enhance process components 3.3 Configure workflows 3.3 Configure workflows 3.4 Test production system 3.4 Test production system 3.1 Build data collection instrument 3.1 Build data collection instrument 5.4 Impute 5.4 Impute 5.8 Finalize data files 5.8 Finalize data files 19 Main Consult with users needs Consult with research Process owner / revised; original UNECE / Steven Vale TiME-LINESS AND PUNCTUALITY TiME-LINESS AND PUNCTUALITY GSBPM: Sub-processes with interest group contacts

Quality Management / Metadata Management 1 Specify Needs 1 Specify Needs 2 Design 2 Design 3 Build 3 Build 4 Collect 4 Collect 5 Process 5 Process 6 Analyse 6 Analyse 7 Disseminate 7 Disseminate 8 Archive 8 Archive 1.1 Determine need for information 1.1 Determine need for information 1.2 Consult and confirm need 1.2 Consult and confirm need 1.3 Establish output objectives 1.3 Establish output objectives 1.5 Check data availability 1.5 Check data availability 1.6 Prepare business case 1.6 Prepare business case 2.1 Design outputs 2.1 Design outputs 2.2 Design variable descriptions 2.2 Design variable descriptions 2.4 Design frame and sample methodology 2.4 Design frame and sample methodology 2.5 Design statistical processing methodology 2.5 Design statistical processing methodology 2.6 Design production system and workflow 2.6 Design production system and workflow 4.1 Select sample 4.1 Select sample 4.2 Set up collection 4.2 Set up collection 4.3 Run collection 4.3 Run collection 4.4 Finalize collection 4.4 Finalize collection 5.1 Integrate data 5.1 Integrate data 5.2 Classify and code 5.2 Classify and code 5.3 Review, validate and edit 5.3 Review, validate and edit 5.5 Derive new variables and statistical units 5.5 Derive new variables and statistical units 5.7 Calculate aggregates 5.7 Calculate aggregates 6.1 Prepare draft outputs 6.1 Prepare draft outputs 6.2 Validate outputs 6.2 Validate outputs 6.3 Scrutinize and explain 6.3 Scrutinize and explain 6.4 Apply disclosure control 6.4 Apply disclosure control 6.5 Finalize outputs 6.5 Finalize outputs 7.1 Update output systems 7.1 Update output systems 7.2 Produce dissemination products 7.2 Produce dissemination products 7.3 Manage release of dissemination products 7.3 Manage release of dissemination products 7.5 Manage user queries 7.5 Manage user queries 7.4 Promote dissemination products 7.4 Promote dissemination products 8.1 Define archive rules 8.1 Define archive rules 8.2 Manage archive repository 8.2 Manage archive repository 8.3 Preserve data and associated metadata 8.3 Preserve data and associated metadata 8.4 Dispose of data and associated metadata 8.4 Dispose of data and associated metadata 5.6 Calculate weights 5.6 Calculate weights 2.3 Design data collection methodology 2.3 Design data collection methodology 9 Evaluate 9 Evaluate 9.1 Gather evaluation inputs 9.1 Gather evaluation inputs 9.2 Conduct evaluation 9.2 Conduct evaluation 9.3 Agree action plan 9.3 Agree action plan GSBPM: Sub-processes with interest group contacts 1.4 Identify concepts 1.4 Identify concepts 3.6 Finalize production systems 3.6 Finalize production systems 3.5 Test statistical business process 3.5 Test statistical business process 3.2 Build or enhance process components 3.2 Build or enhance process components 3.3 Configure workflows 3.3 Configure workflows 3.4 Test production system 3.4 Test production system 3.1 Build data collection instrument 3.1 Build data collection instrument 5.4 Impute 5.4 Impute 5.8 Finalize data files 5.8 Finalize data files 20 Main Consult with users needs Consult with research Process owner / revised; original UNECE / Steven Vale COHEREN CE and COMPARA BILITY GSBPM: Sub-processes with interest group contacts

Quality Management / Metadata Management 1 Specify Needs 1 Specify Needs 2 Design 2 Design 3 Build 3 Build 4 Collect 4 Collect 5 Process 5 Process 6 Analyse 6 Analyse 7 Disseminate 7 Disseminate 8 Archive 8 Archive 1.1 Determine need for information 1.1 Determine need for information 1.2 Consult and confirm need 1.2 Consult and confirm need 1.3 Establish output objectives 1.3 Establish output objectives 1.5 Check data availability 1.5 Check data availability 1.6 Prepare business case 1.6 Prepare business case 2.1 Design outputs 2.1 Design outputs 2.2 Design variable descriptions 2.2 Design variable descriptions 2.4 Design frame and sample methodology 2.4 Design frame and sample methodology 2.5 Design statistical processing methodology 2.5 Design statistical processing methodology 2.6 Design production system and workflow 2.6 Design production system and workflow 4.1 Select sample 4.1 Select sample 4.2 Set up collection 4.2 Set up collection 4.3 Run collection 4.3 Run collection 4.4 Finalize collection 4.4 Finalize collection 5.1 Integrate data 5.1 Integrate data 5.2 Classify and code 5.2 Classify and code 5.3 Review, validate and edit 5.3 Review, validate and edit 5.5 Derive new variables and statistical units 5.5 Derive new variables and statistical units 5.7 Calculate aggregates 5.7 Calculate aggregates 6.1 Prepare draft outputs 6.1 Prepare draft outputs 6.2 Validate outputs 6.2 Validate outputs 6.3 Scrutinize and explain 6.3 Scrutinize and explain 6.4 Apply disclosure control 6.4 Apply disclosure control 6.5 Finalize outputs 6.5 Finalize outputs 7.1 Update output systems 7.1 Update output systems 7.2 Produce dissemination products 7.2 Produce dissemination products 7.3 Manage release of dissemination products 7.3 Manage release of dissemination products 7.5 Manage user queries 7.5 Manage user queries 7.4 Promote dissemination products 7.4 Promote dissemination products 8.1 Define archive rules 8.1 Define archive rules 8.2 Manage archive repository 8.2 Manage archive repository 8.3 Preserve data and associated metadata 8.3 Preserve data and associated metadata 8.4 Dispose of data and associated metadata 8.4 Dispose of data and associated metadata 5.6 Calculate weights 5.6 Calculate weights 2.3 Design data collection methodology 2.3 Design data collection methodology 9 Evaluate 9 Evaluate 9.1 Gather evaluation inputs 9.1 Gather evaluation inputs 9.2 Conduct evaluation 9.2 Conduct evaluation 9.3 Agree action plan 9.3 Agree action plan GSBPM: Sub-processes with interest group contacts 1.4 Identify concepts 1.4 Identify concepts 3.6 Finalize production systems 3.6 Finalize production systems 3.5 Test statistical business process 3.5 Test statistical business process 3.2 Build or enhance process components 3.2 Build or enhance process components 3.3 Configure workflows 3.3 Configure workflows 3.4 Test production system 3.4 Test production system 3.1 Build data collection instrument 3.1 Build data collection instrument 5.4 Impute 5.4 Impute 5.8 Finalize data files 5.8 Finalize data files 21 Main Consult with users needs Consult with research Process owner / revised; original UNECE / Steven Vale ACESSA- BILITY AND CLARITY ACESSA- BILITY AND CLARITY GSBPM: Sub-processes with interest group contacts

GSBPM – Not a linear model 22

III. Process Performance

Quality assessment methods 24

CoP & QAF on Statistical processes 25 Deming: systematic production quality measurement Theory: Plan-Do-Check-Act cycle

PDCA – Continual improvement 26 Plan: What to do? How? Do: Do what was planned Check: Did things happen according to plan? Act: How to improve next time?

Process performance – how to start? 27 study selected indicator and related criteria in detail (in CoP, ESS QAF) review all relevant internal and external documents (regulations) brainstorm in workshops: for selected indicator- what are the criteria about? which phase of the PDCA they address?

Process performance – how to start? 28 Describe the present situation, each indicator separately: P – Plan – specify documents where the subject is planned (regulations: policy, plans, internal directives,...) If the subject is not described... Improvement action D – Do – describe „doing“ (more detail description if there is no regulation in P) C, A – Check, Act – describe how is monitored what was planned, measured, evaluated, where it is stated; how improvement actions are formulated, implemented

Process performance – how to carry on? 29 Formulate improvement actions for the whole indicator Assess whether the description in sufficiently addresses criteria of the indicator (as stated in ESS QAF brochure), revise if needed Summarise documents that will be used as evidence (auditing, peer review,...) Evaluate improvement actions Update description (improvement actions) if necessary

Fostering Interoperability in OS CSPA: Common Statistical Production Architecture 30 Two major threats of statistical organisations Rigid processes and methods Inflexible ageing technology environments -> Accidential architecture Processes and methodology changes are time consuming and expensive result in an inflexible, unrepsonsive statistical organisation CSPA – sharing and reuse of statistical services both across and within statistical organisations

Goal of CSPA Provide statistical organisations a standard framework to: 31 Facilitate process of modernization Provide guidance for operating change within statistical organizations Provide statisticians with flexible information systems to accomplish their mission and to respond to new challenges and opportunities Reduce costs of production through the reuse / sharing solutions and services and the standardization processes Provide guidance for building reliable and high quality services to be shared and reused in a distributed environment Enable international collaboration initiatives for building common infrastructures and services Foster alignment with existing industry standards like GSBPM and GSIM Encourage interoperability of systmes and processes

CSPA - The main changes required at the organization level can be grouped in layers 32 People Changes Openness to international cooperation Building trust in international partners(especially as they may be building services for your organization) Sense of compromise (acceptance that nothing will be optimized for local use, rather it will be optimized for international or corporate use) Development of new functional roles to support use of the architecture (e.g. Assembler, Builder)

CSPA - The main changes required at the organization level can be grouped in layers 33 Process Changes Adoption of an industry wide perspective Different approach to business process management and design Commitment to service (contract between different functional units)

Goal of CSPA Provide statistical organisations a standard framework to: 34 Technology Changes setting up an adequate middle ware infrastructure (messaging, repositories) uplift of physical network capabilities (bandwidth, etc.) management of security features