Cristina Casciano, Viviana De Giorgi, Filippo Oropallo Istat Division for Structural Business Statistics, Agriculture, Foreign Trade and Consumer Prices.

Slides:



Advertisements
Similar presentations
Statistics NZs experience in using Administrative Data in an Integrated Programme of Economic Vince Galvin General Manager Strategy & Communications.
Advertisements

The Business Register Research, Design and Evaluation Division Statistical Institute of Jamaica.
Possibilities of exploiting administrative data in short term statistics in Poland Jacek Kowalewski STATISTICAL OFFICE IN POZNAŃ.
Some considerations on developing a DWH for SBS estimates Orietta Luzi – Mauro Masselli Istat - Italy march 2013.
Fabienne Fortanier Head of Trade Statistics OECD
Statistics Portugal « 27 th February 2013 « Experience of Administrative Data in the Production of Business Statistics «
Results and next steps from the ESSnet Admin Data Alison Pritchard Business Outputs & Developments, Office for National Statistics, UK 4 December 2012.
UNECE Work Session on Statistical Data Editing Vienna April 2008 Topic ii – Editing Administrative Data and Combined Sources.
1 Editing Administrative Data and Combined Data Sources Introduction.
The Use of Administrative Sources for Statistical Purposes Administrative Sources and Statistical Registers.
Trade and business statistics: use of administrative data Lunch Seminar Enrico Giovannini Italian National Statistical Institute (ISTAT) New York, February,
Use of administrative data in statistics - challenges and opportunities ICES III End Panel Discussion Montreal, June 2007 Heli Jeskanen-Sundström Statistics.
1 Constructing and Maintaining a Business Register: Singapore’s Experience By Ong Lai Heng Singapore Department of Statistics International Workshop on.
Combining administrative and survey data: potential benefits and impact on editing and imputation for a structural business survey UNECE Work Session on.
Work Package 5: Integrating data from different sources in the production of business statistics Daniel Lewis Office for National Statistics (UK)
Carmela Pascucci – Istat - Italy Meeting of the Working Party on International Trade in Goods and Trade in Services Statistics (WPTGS) Linking business.
Antonio Bernardi - Fulvia Cerroni - Viviana De Giorgi (Istat) An application to the Tax Authority Source (Sector Studies) Session: Administrative data.
Rudi Seljak, Metka Zaletel Statistical Office of the Republic of Slovenia TAX DATA AS A MEANS FOR THE ESSENTIAL REDUCTION OF THE SHORT-TERM SURVEYS RESPONSE.
12th Meeting of the Group of Experts on Business Registers
What can we learn from the link between Trade and Business statistics? The Italian experience Stefano Menghinello, Filippo Oropallo, Marco Giorcelli National.
1 Item 7: National Accounts And Employment Data Using Employment Statistics in the Russian National Accounts Alexander Surinov Deputy Head of Rosstat Joint.
1 Presentation to OG6 Canberra, Australia May 2011 Statistical Uses of Administrative Data in Canada.
Integrating administrative and survey data in the new Italian system for SBS: quality issues O. Luzi, F. Oropallo, A. Puggioni, M. Di Zio, R. Sanzo Nurnberg,
1 11 th Joint UNECE/Eurostat/OECD Seminar on Business Registers Valentín Llorente García (INE - Spain) Session 3: Business Register as a source for further.
Quality issues on the way from survey to administrative data: the case of SBS statistics of microenterprises in Slovakia Andrej Vallo, Andrea Bielakova.
IMPUTING MISSING ADMINISTRATIVE DATA FOR SHORT-TERM ENTERPRISE STATISTICS Pieter Vlag – Statistics Netherlands Joint work with DESTATIS, Statistics Estonia,
Eurostat Overall design. Presented by Eva Elvers Statistics Sweden.
Deliverable 2.6: Selective Editing Hannah Finselbach 1 and Orietta Luzi 2 1 ONS, UK 2 ISTAT, Italy.
Combining survey and administrative data to create a new input data file for National Accounts processes Shaun McLaughlin Central Statistics Office, Ireland.
European Conference on Quality 2008 in Official Statistics Session on Administrative data. M. Carla Congia, Silvia Pacini, Donatella Tuzi
Statistics Portugal « (Quality Rome, 10 July 2008) « Simplified Business Information: « Improving quality by using administrative data in Portugal.
Handling inconsistencies in integrated business data Bonn September 2006 * Jeffrey Hoogland Ilona Verburg.
The new multiple-source system for Italian Structural Business Statistics based on administrative and survey data Orietta Luzi, Ugo Guarnera, Paolo Righi.
By M.G. Calza, P. Cella, F. Oropallo, S. Rossetti, C. Viviano ISTAT-Eurostat-OECD Workshop on Entrepreneurship Indicators Rome, December 6-7, 2006 Performance,
ORGANISATION FOR ECONOMIC CO-OPERATION AND DEVELOPMENT ORGANISATION DE COOPÉRATION ET DE DEVELOPMENT ÉCONOMIQUES OECDOCDE Workshop on improving statistics.
Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.
>>. ESSnet Measuring Global Value Chains 1.Globalisation indicators 2.Methodological development and support for International Organisation and Sourcing.
ESSnet AdminData Methods of estimation for business statistics variables that cannot be obtained from administrative data sources (WP3) Duncan Elliott.
© Federal Statistical Office Germany, Division IB, Institute for Research and Development in Federal Statistics Sheet 1 Surveys, administrative data or.
Copyright 2010, The World Bank Group. All Rights Reserved. Principles, criteria and methods Part 2 Quality management Produced in Collaboration between.
1 For a Population Statistical Register Characteristics and Potentials for the Official Statistics Central department for administrative data and archives.
Data sources of the EuroGroups Register Presentation by Eurostat
Experience and response in developing countries: the twinning project with the Tunisian National Statistical Institute Monica Consalvi ISTAT, Division.
Costa Rica´s business registry: Directory of institutional units and establishments Contacts: Odilia Bravo:
STS Compilation with Multiple Data Sources Anu Peltola Economic Statistics Section, UNECE UNECE Workshop on Short-Term Statistics (STS) and Seasonal Adjustment.
Multivariate selective editing via mixture models: first applications to Italian structural business surveys Orietta Luzi, Guarnera U., Silvestri F., Buglielli.
Report on the work of the TF on SME Data item 6 of the agenda Structural Business Statistics Working Group 14 April 2015, Luxembourg Tatiana Mrlianová.
Fulvia Cerroni - Viviana De Giorgi (Istat) Session 11: Use of administrative data in the statistical system 15 October 2008 The Tax Authority Source as.
1 Statistical Business Register Infrastructure for statistical production systems Regional Seminar on Implementation of 2008 SNA and Supporting Statistics.
ORGANISATION FOR ECONOMIC CO-OPERATION AND DEVELOPMENT ORGANISATION DE COOPÉRATION ET DE DEVELOPMENT ÉCONOMIQUES OECDOCDE Structural Business Statistics.
Meeting of Task Force on Small and Medium Sized Enterprise Data (SMED ) 13 th April 2015, 10:00-17:00 Inclusion of all economic sectors in SBS Giampiero.
Linked employer-employee data in Finland Katariina Nilsson Hakkala Helsinki School of Economics and Government Institute for Economic Research (VATT)
Administrative Data and Official Statistics Administrative Data and Official Statistics Principles and good practices Quality in Statistics: Administrative.
M O N T E N E G R O Negotiating Team for Accession of Montenegro to the European Union Working Group for Chapter 18 – Statistics Bilateral screening: Chapter.
4-6 September 2013, Vilnius Quality in Statistics: Administrative Data and Official Statistics USING ADMINISTRATIVE DATA SOURCES IN OFFICIAL.
Methods for Data-Integration
CARICOM.
Task Force on Small and Medium Sized Enterprise Data (SMED)
Re-engineering the French Business Register ( )
Quality Aspects and Approaches in Business Statistics
Prague EU-SILC Best Practice Workshop, 14th and 15th September 2017
ADMINISTRATIVE DATA IN ANNUAL BUSINESS STATISTICS OF LATVIA
Goals and objectives of Work package 2 of the ESSnet on Consistency of concepts and applied methods of business and trade-related statistics Norbert Rainer,
Italian situation in the following areas:
Istat - Structural Business Statistics
The Challenges in compiling an Education Register in Iceland from multiple sources Ásta M. Urbancic A presentation at the ESSnet on Quality of Multisource.
The Swedish survey on turnover in the service sector
Michaela Grell – Unit G1 – SBS
Task Force on Small and Medium Sized Enterprise Data (SMED)
DETECTING AGGRESSIVE TAX PLANNING
Presentation transcript:

Cristina Casciano, Viviana De Giorgi, Filippo Oropallo Istat Division for Structural Business Statistics, Agriculture, Foreign Trade and Consumer Prices First meeting ESSnet on Data Integration Rome 28 – 29 January 2010 The use of administrative and accounts data for business statistics (ESSnet AdminData)

Background ISTAT is about to start a major research project finalised to support the transition of Italian SBS statistics from a data collection system extensively based on direct reporting (involving around companies) to a new survey system, which is largely based on the use of administrative data sources A more intensive use of administrative data for the compilation of SBS statistics requires to carefully evaluate the most relevant administrative data sources with respect to different types of business population (large companies, small and medium size companies, micro-businesses), and to carefully assess the impact of potential sources of biases in those data Administrative data sources are currently used for the compilation of SBS statistics to produce preliminary estimates, as requested by the SBS Regulation. They are also used as a complementary source of business data with respect to direct reporting to produce definitive SBS data. They are also used for the construction of Italian Business Register (Asia), including demography, and the Oros database (Employment, wage, salary and social contributions STS) First meeting ESSnet on Data Integration Rome, January 29, 2010

ESSnet AdminData First meeting ESSnet on Data Integration Rome, January 29, 2010

WP5 - Plan of activities for the period Assessing the relevance of data matching and definitions inconsistency problems arising when combining multiple administrative data sources (balance sheet data, VAT data, Fiscal authority surveys) with survey data Design and testing of a methodological approach (and drafting related recommendations) finalized to deal with inconsistency in variables and data matching problems arising from the use of fiscal data in the estimation of SBS data with respect to the smaller size classes (small and micro- businesses) Designing and testing the appropriate methodological approach (and drafting related recommendations) finalized to statistically amend inconsistency in variables and data matching problems arising from the use of balance sheet data in the estimation of SBS data with respect to the larger size classes (medium and large businesses) Designing and testing the proper methodological approach (and drafting related recommendations) finalized to properly use complementary fiscal and administrative data sources to estimate specific variables and segments of the SBS target population not covered by the above mentioned data sources. Defining the final reports and comparison with other EU countries Rome, January 29, 2010 First meeting ESSnet on Data Integration

Italian Case – Proposed Actions (First Year) -Integration issues: -Matching issues: detecting different subset of Population (micro- small/medium-large; Unincorporated/Corporated) -Metadata issues: comparison between SBS definitions and Fiscal data - Review of Administrative sources useful to produce Structural Business Statistics (SBS Eu reg. 58/97, 410/98, 2700/98, 2056/02, 1670/03, 295/2008) - First step in the reconstruction of the main economic variables for Small firms by using Fiscal sources Rome, January 29, 2010 First meeting ESSnet on Data Integration

Integration issues (1) Advantages: - Reduce statistical burden - Reduce bias in estimates (due to TMR) - Reduce costs - Timeliness in producing estimates Drawbacks: - Confidentiality problems related to the Administrative data access - Administrative data are customarily collected for different purposes - No control on data production process at the origin (to check missing values, outliers, etc.). Cooperation with Agencies that provides data should be considered. - They may refer to legal units not statistical units Rome, January 29, 2010 First meeting ESSnet on Data Integration

Integration issues (2) Matching different data sources (statistical/administrative) means tackling a host of issue, e.g.: Identifying business units i.e. find an identifying variable which is a unique key that is a natural join between different sources. In almost all firm databases we choose the fiscal code (available from Asia) Dealing with Matching Problems i.e. whenever a key variable is unavailable or is not sufficient to identify the statistical unit. In case of mis-matches or when sources do not contain the same unit Identifying changes in business units Changes involving a single unit (changes in kind of business classification, in legal form or localisation) Changes in the number of units (death, birth, breaks up and splits off, mergers and acquisitions) Addressing sampling problems When merging survey data with exhaustive data from a subset of the population Reconciling definitions and values among sources Whenever a variable has not the same definition or value across different sources Handling data editing and data reconstruction issues Measurement Errors, Missing data, Outliers etc Rome, January 29, 2010 First meeting ESSnet on Data Integration

Review of sources 1) Fiscal Agency Fiscal Survey Purpose  Aiming to enhance fiscal compliance Not all firms Tax Return data  Unico (personal tax), 770 (witholding tax on employees and temporary workers More info for micro_firms with simplified bookkeeping. Less info for other firms VAT data  Changes in legal unit and Turnover data 2) Chambers of Commerce Balance Sheet Data All Corporate firms Better coherence with SBS variables 3) Social Security Institute Data from monthly declaration of the enterprise on employees All firms with at least 1 employee in a months of the year Number of employees, typology, wage and salary, social contributions Rome, January 29, 2010 First meeting ESSnet on Data Integration

Purpose of Administrative sources  To support Tax Admin. control action on small and medium firms Population coverage  Single ownerships, Partnerships and corporate firms Turnover greater than € and less than 7,5 million € Roughly 4 million of records Variables  More balance-sheets-comparable variables (Turnover, Value of Production, Intermediate costs, Value Added, Personnel costs, Gross and net operating surplus) Different definition of accounting variables (e.g. Freelancers) First step in the reconstruction of the main economic variables for SME by using Administrative data (1) Rome, January 29, 2010 First meeting ESSnet on Data Integration

First step in the reconstruction of the main economic variables for SME by using Administrative data (2) Rome, January 29, 2010 First meeting ESSnet on Data Integration Coverage analysis by legal type and size class

First step in the reconstruction of the main economic variables for SME by using Administrative data (3) Rome, January 29, 2010 First meeting ESSnet on Data Integration List of harmonized variables from various sources defined according the SBS regulation and international accounting standard

First step in the reconstruction of the main economic variables for SME by using a Fiscal archive (4) Rome, January 29, 2010 First meeting ESSnet on Data Integration Coverage of the initial sample of SME survey by type of response and administrative data

First step in the reconstruction of the main economic variables for SME by using a Fiscal archive (5) Rome, January 29, 2010 First meeting ESSnet on Data Integration Integration scheme

First step in the reconstruction of the main economic variables for SME by using a Fiscal archive (6) Rome, January 29, 2010 First meeting ESSnet on Data Integration Calibration and bias estimation Final estimates on the subset of respondents (S1) Final estimates on the integrated sample (S2) The difference in the final estimation is equal to In this way we can distinguish, in the final estimated difference, two possible bias due to: - The source substitution effect for S1 = - Difference originated from the calibration procedure for S2 = If we add and subtract is zero for all units of S2 not included in S1, we obtain: where

First step in the reconstruction of the main economic variables for SME by using a Fiscal archive (7) Rome, January 29, 2010 First meeting ESSnet on Data Integration

First step in the reconstruction of the main economic variables for SME by using a Fiscal archive (8) Rome, January 29, 2010 First meeting ESSnet on Data Integration

First step in the reconstruction of the main economic variables for SME by using a Fiscal archive (7) Rome, January 29, 2010 First meeting ESSnet on Data Integration CDF of weights w and w*

First step in the reconstruction of the main economic variables for SME by using a Fiscal archive (7) Rome, January 29, 2010 First meeting ESSnet on Data Integration Distribution of old and new weights

First step in the reconstruction of the main economic variables for SME by using a Fiscal archive (8) Rome, January 29, 2010 First meeting ESSnet on Data Integration Bias and evaluation of errors on Y=Turnover After a simulation of 1000 re-sampling

Looking ahead Heavily reduced missing response rates and reduced impact of the calibration procedure Analysis of two types of estimation bias for other variables: - Source substitution effect - Total non response effect Evaluation of the Absolute Relative Bias and the Root Mean Square Error of the two estimates Y and Y* Development of data imputation pattern to cover: - remaining variables not contained in administrative data (as PMR) - mismatches (as TMR) Restructuring SBS by integrating Administrative sources in the statistical production process Rome, January 29, 2010