Using the GSBPM in Practice Steven Vale UNECE steven.vale@unece.org

Introduction The original aim of the GSBPM was to standardise terminology for discussions on statistical metadata systems and processes But now it has many other uses: (Quotes from GSBPM 5.0)

Documentation “The GSBPM provides a structure for organizing documentation, promoting standardisation and the identification of good practices”

Process quality management “If a benchmarking approach to process quality assessment is to be successful, it is necessary to standardise processes as much as possible. The GSBPM provides a mechanism to facilitate this”

Integrating metadata and quality “The common framework provided by the GSBPM helps to integrate international work on statistical metadata and data quality by providing a common framework and terminology to describe the statistical business process”

Building organisational capability “The GSBPM can be used to develop a framework assess the knowledge and capability that already exists within an organisation, and to identify the gaps that need to be filled to improve operational efficiency”

Documentation Example: Armenia - 2011 Population Census

Similar approaches are now widely used in many other countries

February 2014 – pilot surveys description Belarus: Using GSBPM 5.0 to describe the existing statistical production processes February 2014 – pilot surveys description Labour statistics Industry Statistics 10-12 June 2014, Nizhny Novgorod, Russia

Results: Identification of gaps in the existing processes Lack of necessary documentation Existence of unsettled processes 10-12 June 2014, Nizhny Novgorod, Russia

Purpose of documentation Needs to be agreed before work starts! Examples: Knowledge management Succession planning Standardisation – understanding the starting point Metadata / quality management International reporting

What to document? For the whole process: Summary of purpose Sources, outputs and users Links to other processes Costs?

What to document? For GSBPM sub-processes: Purpose Inputs and outputs (use GSIM?) Tools and methods Quality criteria When to move on to next sub-process Costs?

Comparison Documentation Efficiency!

How to begin? Read the GSBPM sub process descriptions: 2.3. Design collection This sub-process determines the most appropriate collection method(s) and instrument(s). The actual activities in this sub-process will vary according to the type of collection instruments required, which can include computer assisted interviewing, paper questionnaires, administrative data interfaces and data integration techniques. This sub-process includes the design of collection instruments, questions and response templates (in conjunction with the variables and statistical classifications designed in sub-process 2.2 (Design variable descriptions)). It also includes the design of any formal agreements relating to data supply, such as memoranda of understanding, and confirmation of the legal basis for the data collection. This sub-process is enabled by tools such as question libraries (to facilitate the reuse of questions and related attributes), questionnaire tools (to enable the quick and easy compilation of questions into formats suitable for cognitive testing) and agreement templates (to help standardise terms and conditions). This sub- process also includes the design of process-specific provider management systems.

Bring together all colleagues who are involved in the process How to begin? Bring together all colleagues who are involved in the process Agree and describe the steps needed to complete the process Document them! Benefits include increased transparency and identifying areas for improvement Discussions often bring new ideas

GSBPM and Quality Quality indicators task team Canada, Hungary, Italy, Turkey, Eurostat Mapping existing quality indicators to GSBPM sub processes Determining generic quality indicators for each sub-process Processes based on surveys: 2016 Processes based on administrative data: 2017

Quality and Metadata Management Needed at many different levels: Process / sub-process level – GSBPM Organisation level – GAMSO

Applying GSBPM to statistical processes

Australia - Prices

Denmark - quarterly survey on employment in construction

Ireland - Tourism Survey

Armenia - Electrical Transport

Kyrgyzstan: Pilot Survey of the Dordoy Market

A pilot statistical product “Dordoy Market Survey” Activity Contribution of Dordoy market in GDP Analyze users’ needs in specific statistical data: Turnover; Infrastructure of the market (café, containers, hair-dressing saloons, banks etc.); One-time survey; Searching stakeholder (public authorities) that could be engaged in data collection Coverage Instructions, rules Resources Human resources: economists, statisticians Link back to earlier processes 1.1. Determine needs for information Input Statement of the Government Task set by NSC top management the World Bank publication “Skeins of Silk: Borderless Bazaars and Regional Integration in Central Asia Colour 1. Specify needs Output Determine: specific statistical data on economic entities need for conducting Dordoy market survey The National Statistical Committee of the Kyrgyz Republic 25

A pilot statistical product “Dordoy Market Survey” Specify needs Design Build Collect – exhaustive survey Collect – sample survey Process Analyse Disseminate Evaluate 1.1 Identify needs 2.1 Design outputs 3.1 Build collection instrument 4.1 Create frame & select sample 5.3 Review and validate 6.2 Validate outputs 7.2 Produce dissemination products 8.1 Gather evaluation inputs 1.2 Consult and confirm needs 2.2 Design variable descriptions 3.2 Build or enhance process components 4.2 Se4t up collection 5.4 Edit and impute 6.3 Interpret and explain outputs 7.3 Manage release of dissemination products 8.2 Conduct evaluation 1.3 Establish output objectives 2.3 Design collection 3.3 Build or enhance dissemination components 4.3 Run collection 5.7 Calculate aggregates 8.3 Agree an action plan 1.4 Identify concepts 2.4 Design frame and sample 3.4 Configure workflow 4.4 Finalize collection 5.8 Finalize data files 1.5 Check data availability 2.5 Design processing and analyses 1.6 Prepare business cases 2.6 Design production system and workflow Of 44 sub-processes completed - 35 sub-processes are for one-time survey 26

Need and advantages of using GSBPM Description of pilot statistical product “Dordoy” has led to the following conclusions: - Standardization of processes; - Avoiding duplication; - Facilitation of staff rotation; - Documentation of processes from A to Z; - Audit of work quality (both internal and external); - Identification of bottlenecks and gaps; - Links with the common database to post all documents/instructions on INTRANET. Geneva, 21-23 September, 2016 27

GSBPM implementation information

GSBPM Paper EN / FR / RU Automatic translations to over 100 languages

https://statswiki.unece.org/display/GSBPM GSBPM Wiki https://statswiki.unece.org/display/GSBPM

Training materials Modernisation Workshop, Estonia, Dec 2014 Introduction to GSBPM GSBPM and Business Registers GSBPM Workshop, Malta, Sept 2014 Mapping data production processes to GSBPM GSBPM in documentation, metadata and quality management GSBPM and other standards Краткая информация о ТМПСИ (GSBPM Overview in Russian)

YouTube video

Implementations and case studies

Discussion forum

Other papers on the web