Guidelines on Statistical Business Registers Draft Chapter 8: Quality of SBR Caterina Viviano, Monica Consalvi ISTAT Meeting of the Group of Experts on Business Registers, 2-4 September 2013, Geneva

1.Provide guidance on how to evaluate quality for SBR 2.Describe quality criteria with an eye to the complexity of SBR 3.Provide measurement tools for quality evaluation 4.Suggest a conceptual framework to build up quality indicators, some practical examples 5.Strategies for improving quality Purpose 1 Draft chapter 8: quality of SBR, Caterina Viviano, Monica Consalvi– Geneva, 2-4 September 2013

1.Quality components 2.Specificities of SBR in comparison with a survey (extensive use of administrative data; heterogeneity and variability of inputs, users, relevant units; relevance of technological aspects; the continuous updating; etc..) 3.Frame errors: an overall description of the main errors and consequences in statistical outputs 4.Tools for quality evaluation and metadata 5.The conceptual framework for quality indicators Overview 2 Draft chapter 8: quality of SBR, Caterina Viviano, Monica Consalvi– Geneva, 2-4 September 2013

5. Framework for quality indicators (1) 3 Draft chapter 8: quality of SBR, Caterina Viviano, Monica Consalvi– Geneva, 2-4 September 2013 The three dimensions for defining a Quality Indicator: 1. The BR’s phases (Input, Process, Output) 2. The quality components (relevance, accuracy, timeliness, punctuality, accessibility and clarity, comparability, coherence) 3.The key factors (time, scope, sub-population, variable, criterion)

5. Framework for quality indicators (2) 4 Draft chapter 8: quality of SBR, Caterina Viviano, Monica Consalvi– Geneva, 2-4 September 2013 Example: to evaluate the completeness in 2-digit Nace code when using a given input source to update economic activity in a given sub-population (i.e. large ent.) of the SBR I(t)% = % 2-digit Nace missing codes (out of the total number of units) in large enterprises at time t in input source Tax register I(t, t-1) = Percentage variation Var[I(t)%, I(t-1)%] 1.phase: Input (source=tax register) 2.component: Relevance-completeness 3.factors: Variable=economic activity; scope=enterprises; sub- pop=ent employees; criterion=temporal consistency

1.To better address quality components to the SBR peculiarities 2.to develop indicators to measure each single quality dimension 3.Add quality reports as tool for quality evaluation 4.Due to the huge use of administrative data, is it necessary to develop more in-depth the assessment of the quality of administrative sources? To which extent quality of administrative sources should be described in Ch. 6 or Ch.8 ? Issues for discussion (further in-depth analysis) 5 Draft chapter 8: quality of SBR, Caterina Viviano, Monica Consalvi– Geneva, 2-4 September 2013

Good practices from countries (1) SBR Quality Indicators - Italy (some examples taken from the quality declaration) 6

Good practices from countries (2) SBR Quality Indicators – Colombia (some examples of proposed indicators) Any other suggestions / good practices? 7

Titolo intervento, nome cognome relatore – Luogo, data Contacts 8 Caterina Viviano, Monica Consalvi,