Download presentation
Presentation is loading. Please wait.
Published byEverett Lewis Modified over 9 years ago
1
The Use of Administrative Sources for Statistical Purposes Steven Vale United Nations Economic Commission for Europe
2
What are Administrative Sources?
3
Eurostat ‘CODED’ Glossary: An administrative source is the organisational unit responsible for implementing an administrative regulation (or group of regulations) for which the corresponding register of units and the transactions are viewed as a source of statistical data. Source: OECD and others, "Measuring the Non-Observed Economy: A Handbook",
4
Narrow Definition
5
Wider Definition
6
Administrative sources are sources containing information which is not primarily collected for statistical purposes.
7
Reasons for this definition Increasing privatisation of government functions Growth of private sector data and “value-added re-sellers” User interest in new types of data
8
Examples of Administrative Sources
9
Tax data - Personal income tax - Value Added Tax (VAT) - Business / profits tax Social security data Health / education records Registration systems for persons / businesses / property / vehicles
10
Published business accounts Internal accounting data Data held by private businesses: - credit agencies - business analysts - utility companies - telephone directories - retailers with store cards etc.
11
The Benefits of Using Administrative Sources
12
Cost Surveys are expensive, a census is worse, data from administrative sources are often “free” Less staff are needed to process administrative data - no need for response chasing.
13
Cost advantage UK could save €350m Source: Eurostat – Documentation of the 2000 round of population and Housing censuses in the EU, EFTA and Candidate Countries; Table 22
14
Response Burden Using administrative sources: –Reduces the burden on data suppliers –Allows statistics to be compiled more frequently with no extra burden Data suppliers complain if they are asked to provide the same information many times by different government departments
15
Coverage Administrative sources usually offer better coverage of target populations, and can make statistics more accurate: –No survey errors –No (or low) non-response Better coverage gives: –Better small-area data –More detailed information
16
Timeliness Producing statistics from administrative sources can sometimes be quicker than using surveys No need for: –forms design; –pilot surveys; –sample design etc.
17
Public Image Making more use of existing data can enhance the prestige of a statistical organisation by making it seem more efficient The concept of “Joined-up government” is politically appealing
18
Are data from administrative sources as good as data from surveys? Who should judge this? How can we measure quality? How should we report and communicate quality? Quality
19
Definition of Quality International Standard ISO 9000/2005 defines quality as; 'The degree to which a set of inherent characteristics fulfils requirements.’
20
What does this mean? Whose requirements? –The user of the goods or services A set of inherent characteristics? –Users judge quality against a set of criteria concerning different characteristics of the goods or services Therefore, quality is all about providing goods and services that meet the needs of users (customers)
21
Quality Measurement How can we measure the quality of data from administrative sources? There are established methods for measuring the quality of survey data, but these are not always relevant for administrative data
22
Three Aspects of Quality To understand the quality of administrative sources we need to consider: – Quality of incoming data – Quality of processing – Quality of outputs
23
Metadata Knowledge and documentation of the source is vital to help us to understand quality: – How the data are collected – Why they are collected – How they are processed – Concepts and definitions used – etc…
24
Legal Frameworks
25
National Legal Frameworks Most statistical institutions have legislation defining their roles and responsibilities, e.g. a ‘Statistical Law’ Many new statistical laws introduced in the last 10 - 15 years Some existing statistical laws have been revised to include provisions for the use of administrative data
26
Some national legal frameworks give more powers than others for access to administrative data Historical, political and cultural factors will have an impact on national frameworks, therefore these are not harmonised between countries National Legal Frameworks
27
International Frameworks The European Union is developing a legal framework for official statistics, including references to the use of administrative data
28
Timing Legal frameworks should reflect the desired future position rather than the current reality, otherwise they will quickly become a barrier Start planning now for the next revision to the legal framework
29
Policy Frameworks
30
Government policy on data sharing –How can the national statistical institute influence this? Codes of practice –International –National
31
International Codes of Practice United Nations Fundamental Principles of Official Statistics –Principle 5: Data for statistical purposes may be drawn from all types of sources, be they statistical surveys or administrative records. Statistical agencies are to choose the source with regard to quality, timeliness, costs and the burden on respondents
32
National Codes of Practice Can reassure the public that data will only be used for specific and reasonable purposes Should be made available to the public, e.g. via the internet site of the national statistical institute.
33
Organisational Frameworks
34
Using Administrative Sources in Practice The use of administrative sources is enabled by a legal framework, in the context of a policy framework But - these are not usually detailed enough to cover all the administrative arrangements for access and use
35
What Else is Needed? Some sort of agreement: - Service Level Agreement (SLA) - Administrative Protocol - Contract - Informal or verbal agreement - Other type of agreement according to national customs and practices
36
Agreement Contents 1 Legal basis Names of persons transferring and receiving data Detailed description of data covered Frequency of data supply Quality standards Confidentiality rules
37
Agreement Contents 2 Technical standards Provision of metadata Provisions for payment for supply data Period of agreement Contingencies for changes in circumstances Procedure for resolving disputes
38
Technical Frameworks
39
Mechanisms for data transfer –Paper –Magnetic media –Secure on-line connection File formats Data / metadata standards –XML –SDMX –GESMES
40
Common Problems and Solutions
41
Public Opinion The level of public concern about government departments sharing data varies from country to country There is usually some suspicion of the motives for data sharing Sometimes public opinion favours data sharing
42
Adopt and publish a code of practice following international standards Clearly stated limits and rules may help reduce concerns The principle of the “one-way flow” of sensitive data must be understood by all Solutions
43
Publish cost-benefit analyses of the use of different sources It may be possible to claim that data are more secure – No questionnaires sent by post – Fewer clerical staff, so fewer people with access to data
44
Public Profile Direct contact with the public via surveys helps raise the profile of the statistical office The use of administrative data can reduce contact with the public and awareness of the work of the statistical office
45
Effective ‘marketing’ of the statistical office and data outputs Greater involvement with education institutions, business groups, and other target customers Solutions
46
Units Administrative units may be different to statistical units: – Job / person – Tax unit / enterprise – Dwelling / household They may need to be converted to meet statistical requirements
48
Solutions Automatic rules for simple cases –These must be clear and consistent Statistical “adjustments” –E.g. the statistical unit is persons. The administrative unit is jobs. We know from a survey that working people have, on average, 1.15 jobs. This adjustment factor can therefore be used to estimate persons in employment from jobs Profiling
49
Definitions of Variables Administrative data are collected according to administrative concepts and definitions Administrative and statistical priorities are often different, so definitions are often different
50
Unemployment Statistical definition (ILO) – Out of work – Available for work – Actively seeking work Administrative definitions are often based on those claiming unemployment benefits
51
Solutions Know and document the differences and their impact Use other variables to derive or estimate the impact of the difference Statistical adjustments during data processing
52
Classifications Two scenarios: 1. Same classification system 2. Different classification systems
53
Same Classification Used for different purposes May not be a priority variable for the administrative source Different classification rules Different emphasis, e.g. specific activity rather than main activity
54
Solutions Understand how classification data are collected and what they are used for Provide coding expertise, tools and training to administrative data suppliers
55
Different Classifications (or different versions of the same classification) Not always a 1 to 1 correlation between codes Tools are needed to convert codes from one classification to another
56
Solutions (1) Stress the advantages of using a common classification Offer expertise to help re-classify administrative sources Give early notice of classification changes and help implement them across government
57
Solutions (2) Use text descriptions to re-code administrative data Use probabilistic conversion matrices to convert codes –This results in individual unit classifications not always being correct, but aggregate data should be OK
58
Example of a conversion matrix (Approx. 22% probability of correct code!)
59
Missing Data Impute where possible Many different imputation methods are used. Two common methods are: – Deductive Imputation – Hot-deck Imputation
60
Case Study Eurostat have a project to develop enterprise demography They want to estimate the impact of enterprise births Employment of new enterprises is used, but this variable is often missing or unreliable for new units
61
Solutions Calculate turnover per head ratios to impute missing variables Ratios based on “similar” units by classification and size Problems with outliers therefore trimming used, e.g. x% or mean of inter-quartile range
62
Timeliness Two Issues Data arrive too late Data relate to a different time period
63
Data arrive too late Data from annual tax returns are often only available several months after the end of the tax year, so they are unsuitable for monthly or quarterly statistics Lags in registering “real world” events
64
Solutions Understand the length and impact of lags Adjust data accordingly Look for ways to reduce lags where possible
65
Different Time Periods Administrative reference period (e.g. Financial/tax year) may not be the same as the statistical reference period Monthly average versus point in time (e.g. employment data)
66
Different Time Periods
67
Solutions Statistical corrections or estimations using data from other reference periods Be aware of possible biases when using point in time reference dates
68
Using data from different sources Data from different sources may not agree This may be due to: – Different definitions, classifications, time periods,.... – Errors
69
Solutions Data validation checks Benchmarking against other sources Priority rules for updating from different sources Knowledge of source quality
70
Priority Rules Different sources can be given different priorities for different variables To stop a “low priority” source overwriting a “high priority” one – Use source codes – Use priority / quality markers – Store dates with variables – Load data in reverse priority order
71
Resistance to Change Statisticians may resist the use of administrative data because they: –Do not trust data unless they collect them themselves; –Focus on negative quality aspects; –Have an over-optimistic view of the quality of survey data; –Assume survey respondents comply with statistical norms.
72
Solutions Education (courses like this!) Take a wider view of all the dimensions of quality, and focus on the impact on users Determine the real relative quality of survey and administrative data Identify how cost savings can be used to improve quality and / or increase outputs
73
Change Management Risk of changes in: – Government / administrative policy – Thresholds – Definitions – Coverage – Systems
74
High-Risk Times Immediately after an election Change of minister Change of government policy Change in EU legislation and…. When you least expect it!
75
Solutions Manage the Risk by: –Legal provisions –Contractual agreements –Regular contact with administrative colleagues –Anticipating changes –Contingency plans
76
Administrative Sources and Statistical Registers
77
Direct Use Simplest case - an administrative source is used directly as a sampling frame Easy and cheap Quality problems? Lack of control?
78
Indirect use (1) One or more administrative sources are used to construct a statistical register A statistical register can be a tool for integrating data from different sources
79
Indirect use (2) A statistical register can contain additional variables, e.g. from surveys, imputed, or calculated The statistical register is owned and controlled by statisticians
80
Multiple data sources Data from a single source – no check on accuracy Data from several sources – better view of the accuracy of the data – increased range of variables available – but; how to deal with data conflicts?
81
Models for Creating and Maintaining Statistical Registers using Administrative Data
82
UK Business Register
83
Basic Registers in Sweden
84
Central Register Cross-government projects to create central registers of person / business data to facilitate data sharing, e.g. Registers in Nordic Countries Australian Business Register UK Business Index
85
Satellite Register A satellite register is a tool for incorporating administrative data that are only relevant for a sub-set of units in a statistical register Statistical Register Satellite Register Satellite registers may contain additional units, or variables, or both
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.