1. CSSA 2010: Use of Quality Standards Michael Colledge, Consultant 4 September 2015 1 CCS Quality Meeting May, 2010 Experiences in the Use of Quality Standards Michael Colledge, Consultant

2. CSSA 2010: Use of Quality Standards Michael Colledge, Consultant 4 September 2015 2 Experiences  Assessment of Quality in Statistics (10 central European NSOs)  Development of Quality Guidelines (National Institute of Statistics, Romania)  Quality Assurance in Business Profiling (Statistics South Africa)  Quality Assurance Framework (Statistics Indonesia)  Lessons Learned  Generic Quality Assurance Framework

3. CSSA 2010: Use of Quality Standards Michael Colledge, Consultant 4 September 2015 3 Assessment of Quality in Statistics in 10 Central European Countries  Objectives were to help NSIs to assess quality to provide training in quality  Made use of recently developed ESS generic self- assessment checklist (DESAP)  Each NSI completed checklist for 6 surveys  Consultants reviewed results as basis for identifying probable strengths and weaknesses as starting point for discussions and to target training Checklist was cornerstone of assessment its use fast tracked the work

4. CSSA 2010: Use of Quality Standards Michael Colledge, Consultant 4 September 2015 4 Development of Quality Guidelines at National Institute of Statistics (INS) Romania  Part of a quality improvement programme Small budget item  Started with Statistics Canada’s Quality Guidelines 2003 obtained from Internet used with blessing of Stat Can!!  In discussions with staff, produced revised draft adapted to Romanian situation Use of Stat Can Guidelines fast tracked development, helped assure quality and demonstrated possibility of developing generic guidelines

5. CSSA 2010: Use of Quality Standards Michael Colledge, Consultant 4 September 2015 5 Quality Assurance in Business Profiling at Statistics South Africa (Stats SA), 2008-09  ESPQM Program to improve profiling & train new recruits Work of Profiling Unit had become almost irrelevant Needed good training environment for new recruits Expanded Profiling Unit from 5 by recruiting 13 graduates Had to ensure profiles were good quality  Set up a profiling quality assurance programme using Stat SA quality model (SASQAF) to define elements of quality business process mapping to analyse profiling processes and standardize and insert quality gates Adapted off the shelf quality tools

6. CSSA 2010: Use of Quality Standards Michael Colledge, Consultant 4 September 2015 6 Design of Quality Assurance Framework for Statistics Indonesia  Implementation of quality assurance framework will be a component of forthcoming STATCAP Project; Strengthening the National Statistical System.  Start with Statistics Canada’s National Quality Assessment Framework (NQAF) draft template from UNSC 2010 paper  Adapt to Indonesian situation, which includes Few existing quality tools Opportunity for synergistic relationship with concurrent Bureaucratic Reform Program (which requires business process mapping and improved quality operating procedures) Template is useful in fast tracking and authenticating Need to tailor to local situation

7. CSSA 2010: Use of Quality Standards Michael Colledge, Consultant 4 September 2015 7 Lessons Learned (Nothing new, but reaffirmation in case we should forget)  Standards and Guidelines are invaluable Speed up development Make best practices readily available Basis for harmonisation We could use more at both corporate and survey levels generic quality guidelines, statistical terminology generic NQAF template and guidelines

8. CSSA 2010: Use of Quality Standards Michael Colledge, Consultant 4 September 2015 8 NQAF Template and Guidelines  Following up Claude’s comments  Benefits  Terminology  Scope and Content  Quality management system  Relationship to guidelines  Structure Match to local situation

9. CSSA 2010: Use of Quality Standards Michael Colledge, Consultant 4 September 2015 9 9 michael.colledge@gmail.com