Harmonisation process of anonymisation of microdata

Slides:



Advertisements
Similar presentations
Output Consultation Plans and Statistical Disclosure Control Strategy developments Angele Storey and Jane Longhurst ONS.
Advertisements

Eurostat T HE E UROPEAN PROCESS OF ENHANCING ACCESS TO E UROSTAT DATA A LEKSANDRA B UJNOWSKA E UROSTAT.
Workshop on Standardisation Brussels, October 2010 Comparative review of SDC and SA standards Jean Marc MUSEUX – Eurostat.
Enhancing Data Quality of Distributive Trade Statistics Workshop for African countries on the Implementation of International Recommendations for Distributive.
Developing a Statistical Disclosure Standard for Europe Tanvi Desai LSE Research Laboratory Data Manager Research Laboratory IASSIST 2010: Cornell.
ESS VIP project on Validation
Session 4. Panel session: How useful is the notion of “circle of trust” concept ? A vision for the future. Maurice Brandt Destatis Germany 2ND EUROPEAN.
1 The system aspect of statistical quality Q2014 european conference on quality in official statistics Special session: Consistency of Concepts and Applied.
Dissemination to support Research & Analysis John Cornish.
1 Statistical Disclosure Control Methods for Census Outputs Natalie Shlomo SDC Centre, ONS January 11, 2005.
Luisa Franconi Integration, Quality, Research and Production Networks Development Department Unit on microdata access ISTAT Essnet on Common Tools and.
What is a Business Analyst? A Business Analyst is someone who works as a liaison among stakeholders in order to elicit, analyze, communicate and validate.
Risk Assessments: Patient Safety and Innovation 20 May 2013.
26 August 2011 Future of access to EU confidential data for scientific purposes Jean-Marc Museux Eurostat – 58th ISI conference,
Slide 1 Eurostat Unit B3 – Statistical Information Technologies CoRD Meeting – 4 June 2007 Agenda Item 8 Preliminary ideas for a 2011 census hub Giuseppe.
Data for secondary analysis: the experience of the UK Data Archive Hilary Beedham UK Data Archive.
The Review of the Dissemination of Health Statistics Carole Abrahams Office for National Statistics.
Report on the breakout session on Rapid Estimates Roberto Barcellan European Commission - Eurostat.
Joint Eurostat Unece Worksession on Statistical Data Confidentiality 2011, Tarragona Initial analyses on comparable dissemination from the Essnet project.
Joint UNECE-Eurostat worksession on confidentiality, 2011, Tarragona Sampling as a way to reduce risk and create a Public Use File maintaining weighted.
Joint UNECE/Eurostat work session on statistical data confidentiality October 2015 Helsinki, Finland Circle of trust Maurice Brandt DESTATIS.
Eurostat, Unit G-1 1 EuroGroups Register project UNECE/Eurostat/OECD June 2007 Road Map for the Future.
Framework Regulation Integrating Business Statistics (FRIBS)
Eurostat Overview of the project Meeting of the Expert Group on the integration of the European social surveys January 2015.
OUTCOME OF THE EUROSTAT-ILO-IMF-OECD WORKSHOP ON PENSIONS Paul Goebel Policy Analyst National Accounts Division, OECD Advisory Expert Group on National.
Mirjana Boshnjak Skopje, 20 to 22 September 2017
Disclosure scenario and risk assessment: Structure of Earnings Survey
Session 2: Institutional arrangements for energy statistics
Release of Microdata John Cornish.
Quality assurance in official statistics
Confidentiality in Published Statistical Tables
Legal, political and methodological issues in confidentiality in the ESS Maria João Santos, Jean-Marc Museux Eurostat.
Progress on ESS Validation Project
Access to European microdata for scientific purposes
Measuring Data Quality and Compilation of Metadata
Rolling Review of Education Statistics
Working Group on Statistical Confidentiality, October 2009
ESSnet Projects Pascal JACQUES Unit/B5 Methodology and research
Ola Nordbeck Statistics Norway
Data Validation in the ESS Context
TG EHIS January 2012 Item 3.2 of the agenda EHIS wave 1 anonymised data Bart De Norre, Eurostat.
Data without Boundaries The DwB project (FP7-13)
ESS.VIP ADMIN Sorina Vâju.
BETTER AND PROPER ACCESS TO PACIFIC MICRODATA
Assessment of Quality in Statistics GLOBAL ASSESSMENTS, PEER REVIEWS AND SECTOR REVIEWS IN THE ENLARGEMENT AND ENP COUNTRIES Mirela Kadic, Project Manager.
LAMAS Working Group June 2017
Draft Methodology for impact analysis of ESS.VIP Projects
High-level Working Group on Statistical Confidentiality
Item 4.1 Recent activities in confidentiality and micro data access
ESS VIP ICT Project Task Force Meeting 5-6 March 2013.
Quality Assurance in the European Statistical System
The European Statistics Code of Practice - a Basis for Eurostat’s Quality Assurance Framework Marie Bohatá Deputy Director General, Eurostat ... Strategic.
3.4 Modernisation of Social Statistics
Task Force 3, Cultural Industries Kutt Kommel
Working Group on Statistical Confidentiality
Item 4.3 Confidentiality on the fly
High level working group on statistical confidentiality
Strategies to achieve SDC harmonisation at European level: multiple countries, multiple files, multiple surveys Daniela Ichim and Luisa Franconi Istat,
Adult Education Survey Anonymisation Point 6
Perturbative methods for ESS census tables
Quality reporting in the ESS - State of play and next steps
Business architecture
Dealing with confidential data Introductory course Trainer: Felix Ritchie CONTRACTOR IS ACTING UNDER A FRAMEWORK CONTRACT CONCLUDED WITH THE COMMISSION.
Treatment of statistical confidentiality Introductory course Trainer: Felix Ritchie CONTRACTOR IS ACTING UNDER A FRAMEWORK CONTRACT CONCLUDED WITH THE.
REFLECTIONS ON THE SUSTAINABILITY OF ARGUS
Meeting of the EHIS Technical Group Luxembourg January 2012
Secondary confidentiality in European business statistics
… Two-step approach Conceptual Framework Annex I Annex II Annex III
Item 5 Wim Kloek, Eurostat
Item 2.2 Scientific Use Files for the Time Use Survey
Presentation transcript:

Harmonisation process of anonymisation of microdata

Introduction Guidelines for anonymisation of social survey microdata have been developed by means of Eurostat methodological framework contract and supplemented with comments and feedback of Expert Group's members. A framework for harmonised dissemination of microdata datasets has been developed and tested within the ESSnet on SDC.

A similar process Step1 Identify users' needs and constraints of data producer Step2 Understand data Step 3 Identify circumstances disclosure is likely to occur (disclosure scenarios) Step4 Assess disclosure risk and its impact Step 5 Select appropriate SDC methods Step 6 Implement and disseminate

Applicability Guidelines ESSnet on SDC – to social surveys + applicable to each country one by one + more flexibility: different approaches possible by country or group of country – more work to reach the best balance between info loss and data protection + to microdata (both business and social surveys) + an integrated and harmonised approach - requires a coordinated development of software tool

Risk assessment Guidelines ESSnet on SDC + does not depend to the purpose of data analysis – subjective concept of data utility – difficult to identify the right balance between data utility and data confidentiality + less subjective concepts of benchmarking statistics and setting up thresholds – highly related to the given purpose of data analysis the ability of SDC methods to maintain some predefined characteristics is a crucial point

SDC methods Guidelines ESSnet on SDC + simplicity + flexibility to apply different methods across countries – less harmonisation – complexity + conditions to apply complex SDC methods are more likely to be met and exploited

Governance Guidelines ESSnet on SDC + no agreement across countries required – the governance of a complex production process is one of key issues to be defined and agreed by all the involved actors

Conclusion: both approaches can coexists No comparability of performance can be done as it highly depends on assumptions (disclosure scenarios) and subjective quality measures (data utility versus benchmarking statistics) Disclosure scenarios are always according to national situations and legislation Testing phase is crucial in both approaches Features of statistical domain or statistical analysis are crucial factors in choosing SDC methods Freedom to data producer which alternative follows