Strategies to achieve SDC harmonisation at European level: multiple countries, multiple files, multiple surveys Daniela Ichim and Luisa Franconi Istat,

Slides:



Advertisements
Similar presentations
ONS data – improving access Richard Laux National Statistics and International Division, ONS.
Advertisements

Statistical Disclosure Control (SDC) for 2011 Census Progress Update Keith Spicer – ONS SDC Methodology 23 April 2009.
Output Consultation Plans and Statistical Disclosure Control Strategy developments Angele Storey and Jane Longhurst ONS.
Eurostat T HE E UROPEAN PROCESS OF ENHANCING ACCESS TO E UROSTAT DATA A LEKSANDRA B UJNOWSKA E UROSTAT.
Workshop on Standardisation Brussels, October 2010 Comparative review of SDC and SA standards Jean Marc MUSEUX – Eurostat.
Confidentiality risks of releasing measures of data quality Jerry Reiter Department of Statistical Science Duke University
Business microdata dissemination at Istat Daniela Ichim Luisa Franconi
Developing a Statistical Disclosure Standard for Europe Tanvi Desai LSE Research Laboratory Data Manager Research Laboratory IASSIST 2010: Cornell.
Multiple Indicator Cluster Surveys Data Dissemination and Further Analysis Workshop Data Archiving MICS4 Data Dissemination and Further Analysis Workshop.
Session 4. Panel session: How useful is the notion of “circle of trust” concept ? A vision for the future. Maurice Brandt Destatis Germany 2ND EUROPEAN.
Dissemination to support Research & Analysis John Cornish.
Accreditation practices at the Hungarian Central Statistical Office Zoltán Vereczkei Methodology Department Hungarian Central Statistical Office
Luisa Franconi Integration, Quality, Research and Production Networks Development Department Unit on microdata access ISTAT Essnet on Common Tools and.
User-focused Threat Identification For Anonymised Microdata Hans-Peter Hafner HTW Saar – Saarland University of Applied Sciences
Sponsorship on Standardisation Main results Barteld Braaksma, Cecilia Colasanti, Piero Demetrio Falorsi, Wim Kloek, Miguel Angel Martínez Vidal, Jean-Marc.
EU Funding opportunities : Rights, Equality and Citizenship Programme Justice Programme Jose Ortega European Commission DG Justice.
WP 19 Assessment of Statistical Disclosure Control Methods for the 2001 UK Census Natalie Shlomo University of Southampton Office for National Statistics.
26 August 2011 Future of access to EU confidential data for scientific purposes Jean-Marc Museux Eurostat – 58th ISI conference,
Slide 1 Eurostat Unit B3 – Statistical Information Technologies CoRD Meeting – 4 June 2007 Agenda Item 8 Preliminary ideas for a 2011 census hub Giuseppe.
European Conference on Quality in Official Statistics, Rome, July 2008 Community Innovation Survey: a Flexible Approach to the Dissemination of Microdata.
Joint UNECE/Eurostat work session on statistical data confidentiality Manchester, December 2007 Dealing with Confidentiality in Dissemination: The.
Access to EU microdata for research purposes
The Review of the Dissemination of Health Statistics Carole Abrahams Office for National Statistics.
Standardisation in the European Statistical System inventory of normative documents and the standard-setting process – results of the ESSnet on Standardisation.
1 The GSBPM and ESS statistical business process metadata Session 4 H. Linden, Unit B6 Eurostat Workshop on Statistical Metadata (METIS) (Geneva, 5-7 October.
Joint Eurostat Unece Worksession on Statistical Data Confidentiality 2011, Tarragona Initial analyses on comparable dissemination from the Essnet project.
Joint UNECE-Eurostat worksession on confidentiality, 2011, Tarragona Sampling as a way to reduce risk and create a Public Use File maintaining weighted.
Joint UNECE/Eurostat work session on statistical data confidentiality October 2015 Helsinki, Finland Circle of trust Maurice Brandt DESTATIS.
Census 2011 – A Question of Confidentiality Statistical Disclosure control for the 2011 Census Carole Abrahams ONS Methodology BSPS – York, September 2011.
ESSNET Data Integration - Rome, January 2010 ESSNET on Statistical Disclosure Control Daniela Ichim.
From Intrastat to SIMSTAT and ESS.VIP Programme ESTAT Walter Radermacher.
Mirjana Boshnjak Skopje, 20 to 22 September 2017
Disclosure scenario and risk assessment: Structure of Earnings Survey
Data Confidentiality and the Common Good.
"Placement Administration and Support System" – PASS
An assessment framework for Intrusion Prevention System (IPS)
Release of Microdata John Cornish.
EVALUATION OF V&V TOOLS
Access Policy and Dissemination of Microdata By Didier UYIZEYE
Dissemination Workshop for African countries on the Implementation of International Recommendations for Distributive Trade Statistics May 2008,
Legal, political and methodological issues in confidentiality in the ESS Maria João Santos, Jean-Marc Museux Eurostat.
Eurostat D2 – Regional Indicators and Geographical Information
4.1. Data Quality 1.
Access to European microdata for scientific purposes
Harmonisation process of anonymisation of microdata
SDMX: A brief introduction
Modernisation of European Enterprise and Trade Statistics - MEETS OECD-Working Party on International Trade in Goods and Trade in Services Statistics.
Rolling Review of Education Statistics
Disseminating Statistics to the Research Community
ESSnet on common tools and harmonized methodology for statistical data confidentiality Daniela Ichim, Luisa Franconi.
Working Group on Statistical Confidentiality, October 2009
ESSnet Projects Pascal JACQUES Unit/B5 Methodology and research
ESS Vision 2020: ESS.VIP Validation
BETTER AND PROPER ACCESS TO PACIFIC MICRODATA
Introduction to Quality Concepts
Euro-indicators Working Group
Sub-Regional Workshop on International Merchandise Trade Statistics Compilation and Export and Import Unit Value Indices 21 – 25 November Guam.
High-level Working Group on Statistical Confidentiality
Quality Assurance in the European Statistical System
Point 6. Eurostat plans for Time Use Survey data processing and dissemination Working Group on Time Use Surveys 10 April 2013.
Published in: IEEE Transactions on Industrial Informatics
Functional geographies through the package LabourMarketAreas
1. SDMX: Background and purpose
Dealing with confidential data Introductory course Trainer: Felix Ritchie CONTRACTOR IS ACTING UNDER A FRAMEWORK CONTRACT CONCLUDED WITH THE COMMISSION.
Treatment of statistical confidentiality Introductory course Trainer: Felix Ritchie CONTRACTOR IS ACTING UNDER A FRAMEWORK CONTRACT CONCLUDED WITH THE.
REFLECTIONS ON THE SUSTAINABILITY OF ARGUS
Meeting of the EHIS Technical Group Luxembourg January 2012
Access to European microdata for scientific purposes
Item 5 Wim Kloek, Eurostat
ESS conceptual standards for quality reporting
Presentation transcript:

Strategies to achieve SDC harmonisation at European level: multiple countries, multiple files, multiple surveys Daniela Ichim and Luisa Franconi Istat, Unit on Methods for statistical data confidentiality

Outline Motivation The problem: how many releases? Dissemination strategies Multiple countries: comparability Multiple releases and multiple surveys Conclusions

Dissemination process at transnational level: constraints Multiple actors Heterogeneity Laws and Standards: Organisation of the Statistical System Access to original confidential microdata Microdata transmission Microdata dissemination

Multiple … Multiple countries Multiple countries Multiple countries Multiple surveys Multiple countries Multiple countries Multiple countries Multiple countries SURVEY1 TABLES1 PUF1 MFR1 OTHER1 Multiple releases MS1 Multiple releases SURVEY2 TABLES2 PUF2 MFR2 OTHER2 SURVEYX TABLESX PUFX MFRX OTHERX Multiple releases Multiple releases SURVEY1 TABLES1 PUF1 MFR1 OTHER1 Multiple releases MS2 SURVEY2 TABLES2 PUF2 MFR2 OTHER2 SURVEYX TABLESX PUFX MFRX OTHERX Multiple releases SURVEY1 TABLES1 PUF1 MFR1 OTHER1 Multiple releases Multiple releases MS27 SURVEY2 TABLES2 PUF2 MFR2 OTHER2 SURVEYX TABLESX PUFX MFRX OTHERX Multiple releases

Multiple countries:Dissemination Original microdata Utility Anonymized microdata SDL methods Disclosure risk

Dissemination strategies: level 1 Microdata  apply a SDL method Evaluate risk and utility Disclosure risk SDL methods Original microdata Anonymized microdata Single release Utility R U

Dissemination strategies: level 2 Microdata  risk assessment Apply SDL to reduce risk Evaluate utility Anonymized microdata Disclosure risk Utility SDL methods Original microdata Single release R U

Dissemination strategies: level 3 Microdata  risk assessment Apply SDL to reduce risk maintaining some utility Evaluate utility SDL methods Disclosure risk Original microdata Utility Anonimized microdata Single release R U

Dissemination strategies: degrees of freedom List of candidate methods Suitable to the scenario Protect w.r.t. the scenario Easy to use, etc Flexible methods Parameterisation Stratification Bounded utility Tools: open source

Multiple countries – data utility Users need to make comparisons between different countries. HOW to guarantee it? Utility Comparability Multiple countries Comparability Bounded utility

Comparability Comparability aims at measuring the impact of differences in applied statistical concept and procedures when statistics are compared between geographical areas, non-geographical domains or over time. It is the extent to which differences between statistics are attributed to differences between the true values of the statistical characteristics

Comparability: procedures HOW to achieve it? 1 Set benchmarking statistics and assess the effects of different practices on this set of predefined statistics 2 Define thresholds to define when action is needed 3 Agree on a process for choosing acceptable practices Multiple countries

Benchmarking Non-statistical criteria Statistical indicators Thresholds Actions to be performed when the condition is not met Ichim, D., Franconi, L. (2010), ‘Strategies to Achieve SDC Harmonisation at European Level: Multiple Countries, Multiple Files, Multiple Surveys’, J. Domingo-Ferrer and E. Magkos (Eds.): PSD 2010, LNCS 6344, pp. 284–296, 2010. Springer-Verlag Berlin Heidelberg. Multiple countries

Essnet on SDC Harmonisation Proof of concept for the proposed framework Microdata A survey will be chosen Analysis of users’ requirements Benchmarking statistics will be agreed Various methods will be tested Tables Similar approach will be applied to tables (SBS and Inward FATS)

Different dissemination products Microdata, tables, … Conclusions Different dissemination products Microdata, tables, … Harmonisation as a mean of Standardisation Tight collaboration between actors ESSnet during 2011 to make a proof of concept of the proposed framework