Basque Statistics Office Confidentiality Project: Final stages Joint UNECE/Eurostat Work Session on Statistical Data Confidentiality Tarragona, Spain,

Slides:



Advertisements
Similar presentations
Eurostat T HE E UROPEAN PROCESS OF ENHANCING ACCESS TO E UROSTAT DATA A LEKSANDRA B UJNOWSKA E UROSTAT.
Advertisements

Issues in Designing a Confidentiality Preserving Model Server by Philip M Steel & Arnold Reznek.
Statistical Disclosure Control (SDC) at SURS Andreja Smukavec General Methodology and Standards Sector.
Implementation of the CoP in SLOVENIA Cooperation with data users Genovefa RUŽIĆ Deputy Director-General.
Dissemination of U.S. Census Data and Results: The role of ICPSR First Conference of Al-Khawarezmi Committee on Statistics Doha, Qatar 6-8 December 2010.
Using synthetic data to improve the accessibility of the SLS Susan Carsley, SLS Project Manager.
Access routes to 2001 UK Census Microdata: Issues and Solutions Jo Wathan SARs support Unit, CCSR University of Manchester, UK
MONGOLIA COUNTRY REPORT National Statistical Office IPUMS-Global Workshop, Lisbon, Portugal, August 22-26, 2007.
DWB – 2 nd Regional Workshop Athens, October 2014 Adolfo Gálvez INE Accesing microdata for scientific research purposes- INE Spain.
Eurostat M ODES OF ACCESS TO EU MICRODATA IN THE NEW LEGAL FRAMEWORK A LEKSANDRA BUJNOWSKA E UROSTAT S TATISTICAL OFFICE OF THE E UROPEAN U NION.
1 Collection and dissemination of statistics on disability at the United Nations Statistics Division Proposals for the future Expert Group Meeting to Review.
Joint UNECE/Eurostat work session on statistical data confidentiality October 2013 Ottawa, Canada Improvement of access to European microdata Outcome.
United Nations CensusInfo User Application Training Workshop, Cairo, Egypt, October World Population and Housing Census Programme United.
Decentralised and Remote Access to Confidential Data in the ESS (ESSnet DARA) Overview and State of the Art Maurice Brandt Destatis FIRST EUROPEAN DATA.
Country Paper on: Census Data Accessibility, Confidentiality and Copyright Policy: Ethiopia’s Experience Seminar United Nations Regional Seminar on Census.
Session 4. Panel session: How useful is the notion of “circle of trust” concept ? A vision for the future. Maurice Brandt Destatis Germany 2ND EUROPEAN.
United Nations Economic Commission for Europe Statistical Division Applying the GSBPM to Business Register Management Steven Vale UNECE
Metadata driven application for aggregation and tabular protection Andreja Smukavec SURS.
Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September 2011 Overview of Archiving of Microdata Session 4 United Nations.
Microdata Simulation for Confidentiality of Tax Returns Using Quantile Regression and Hot Deck Jennifer Huckett Iowa State University June 20, 2007.
Intruder Testing: Demonstrating practical evidence of disclosure protection in 2011 UK Census Keith Spicer, Caroline Tudor and George Cornish 1 Joint UNECE/Eurostat.
Using IPUMS.org Katie Genadek Minnesota Population Center University of Minnesota The IPUMS projects are funded by the National Science.
LIFE THIRD COUNTRIES Development and Implementation of an Integrated System for the Control and Monitoring of the Urban Wastewater Treatment Plants in.
Record matching for census purposes in the Netherlands Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics Netherlands.
Accreditation practices at the Hungarian Central Statistical Office Zoltán Vereczkei Methodology Department Hungarian Central Statistical Office
Access to microdata in Europe P resented by Michel Isnard – Insee DwB Training Course, Barcelona, Jan
Population Census carried out in Armenia in 2011 as an example of the Generic Statistical Business Process Model Anahit Safyan Member of the State Council.
Mara Cammarrota Italian National Institute of Statistics Development of Information System and Corporate Products, Information Management and Quality Assessment.
Luisa Franconi Integration, Quality, Research and Production Networks Development Department Unit on microdata access ISTAT Essnet on Common Tools and.
Register-Based Census 2011 in Slovenia – Some Quality Aspects Danilo Dolenc Statistical Office of the Republic of Slovenia UNECE-Eurostat Expert Group.
Daniel Beckler United States Department of Agriculture National Agricultural Statistics Service Timothy Mulcahy NORC at the University of Chicago Topic.
Population census micro data for research: the case of Slovenia Danilo Dolenc Statistical Office of the Republic of Slovenia Ljubljana, First Regional.
Multi-source tools for assessing the users’ needs & perception on statistical quality. The Spanish experience. European Conference on Quality in Official.
Access to official statistical micro data at the Statistical Office of the Republic of Slovenia and cooperation with the Slovenian Social Science Data.
The Bahamas1. 2 United Nations Regional Seminar, on Census Data Dissemination and Spatial Analysis SANTIAGO, CHILE MAY 31 - JUNE 3, 2011.
Administrative procedures for microdata access at SURS October 2013.
Regional Workshop MICRODATA ACCESS IN EUROPEAN COUNTRIES – COOPERATION BETWEEN NATIONAL STATISTICAL INSTITUTES AND DATA ARCHIVES 2nd Regional Workshop.
United Nations Regional Seminar on Census Data Dissemination and Spatial Analysis Amman - Jordan 16 – 19 May 2011 Determination of the scope and form of.
Disclosure Avoidance at Statistics Canada INFO747 Session on Confidentiality Protection April 19, 2007 Jean-Louis Tambay, Statistics Canada
Portugal’s Gender Statistics Database: the Gender Profile Economic Commission for Europe Conference of European Statisticians Group of Experts on Gender.
Statistical data confidentiality and micro data in Albania
Access to microdata in Statistics Estonia First DwB European Data Access Forum Luxembourg, 28th March 2012 Tuulikki Sillajõe.
The availability of Dutch census microdata Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics Netherlands Division Social.
JOINT UN-ECE/EUROSTAT MEETING ON POPULATION AND HOUSING CENSUSES GENEVA, MAY 2009 DETERMINING USER NEEDS FOR THE 2011 UK CENSUS IAN WHITE, Office.
The Application for Statistical Processing at SURS Andreja Smukavec, SURS Rudi Seljak, SURS UNECE Statistical Data Confidentiality Work Session Helsinki,
Giving research access to official microdata through the facilities of a National Statistical Institute: INE in Portugal Jose A. PINTO MARTINS - D ISSEMINATION.
Creating Open Data whilst maintaining confidentiality Philip Lowthian, Caroline Tudor Office for National Statistics 1.
United Nations Statistical Commission CensusInfo Learning Centre, 22 February 2010 CensusInfo Project in the Context of the 2010 World Population and Housing.
Access to microdata in the Netherlands: from a cold war to co-operation projects Eric Schulte Nordholt Senior researcher and project leader of the Census.
Joint UNECE/Eurostat work session on statistical data confidentiality Manchester, December 2007 Dealing with Confidentiality in Dissemination: The.
High-Level Forum on Strategic Planning for Statistics in Central Asia Countries Bishkek, Kyrgyz Republic, May 2006 Oleg Kara, Deputy Director General,
Joint Eurostat Unece Worksession on Statistical Data Confidentiality 2011, Tarragona Initial analyses on comparable dissemination from the Essnet project.
Census Office Fernando Casimiro Geneva, July 2010 Portugal – Census results tailored to user needs «
Joint UNECE/Eurostat work session on statistical data confidentiality October 2015 Helsinki, Finland Circle of trust Maurice Brandt DESTATIS.
Michel ISNARD Insee – Head of Legal Affairs Access to individual data in France 28/10/2013.
Access to European Statistical System microdata
Quality assurance in official statistics
Legal, political and methodological issues in confidentiality in the ESS Maria João Santos, Jean-Marc Museux Eurostat.
Presentation 2b 2018 Census Products & Services Engagement.
Item 4.2 Anonymisation rules for Farm Structure Survey
The role of the ECCP (1) The involvement of all relevant stakeholders – public authorities, economic and social partners and civil society bodies – at.
Albania 2021 Population and Housing Census - Plans
ITDG meeting of of October 2011
Commission Activities Eurostat : Latest developments
Item 2.2 of the Agenda Remote access to confidential data for researchers: possible actions under the 7th Framework Programme Pascal JACQUES Unit B 5 15.
Collection and dissemination of data geo-referenced to a 1km² grid Item 3.2 of the draft agenda DSS Meeting 1 and 2 March 2018.
High level working group on statistical confidentiality
Access to European microdata for scientific purposes
OVERVIEW ON STATISTICAL DATA CONFIDENTIALITY AND ACCES TO MICRODATA
Presentation transcript:

Basque Statistics Office Confidentiality Project: Final stages Joint UNECE/Eurostat Work Session on Statistical Data Confidentiality Tarragona, Spain, October 2011

1.Introduction 2.Microdata for standard distribution 2.1. Background 2.2. Methodology for the production of safe microdata 2.3. Surveys analysed 3.In- situ access to researchers 4.Future tasks 5.Conclusions Outline

1. Introduction PeriodActionOutput Research fellowship on data protection techniques and statistical confidentiality. Technical notebook on “Statistical Data Protection Techniques” edited by EUSTAT. April 2000 International Seminar on “Confidentiality and statistical data protection techniques” organized by EUSTAT. Lecturer: L.H. Cox Publication: “Confidentiality and statistical data protection techniques” L.H. Cox edited by EUSTAT. September 2000 Security Analysis of Census TablesInternal report about sensitive crosses and dissemination proposal 2001 Participation in The Joint UNECE/Eurostat Work Session on Statistical Data Confidentiality (Skopje, Macedonia, March) Article: “A comparative test for several threshold values in frequency tables: A Tau- Argus performance example.”

PeriodActionOutput 2002 Tabular Data protection of preliminary results of the Census 2001, using Tau-Argus (optimal method). Publication of suppression patterns for frequency tables with fine geographical levels CASC project pursuit.Testing of Argus software. June 2004 Attendance of PSD (Privacy in Statistical Databases) Conference. (Barcelona, Spain, 6- 9 June) 2005 Staff training on disclosure control and protection software. Internal Workshop on SDC techniques and ARGUS. 1. Introduction

PeriodActionOutput PeriodActionOutput 2006 Work on standard safety criteriaInternal report about analysis of sources and internal situation. December 2006 Attendance of PSD Conference. (Rome, December) Feedback and contacts Constitution of Confidentiality CouncilGroup of experts to assess and deal with issues of confidentiality in terms of distribution 2007 Rules for Website tables and microdata distribution Creation of “Rules of Confidentiality in statistical distribution” Miccrodata generation and in situ access for researchers Public use microfles Microfiles for researchers 1. Introduction

2. Microdata for standard distribution

Until 2008… - Microdata distribution only under request - Few requests - Users: Universities, researchers,… From 2008… - First microdata files for standard distribution - Social and demographic surveys (households and individuals) - Increase of requests - Users: General public Today… - Standard microfiles in the website of EUSTAT - Request form (user identification; the objective of the request) - Business surveys: in-situ access for researchers 2.1 Backgrund

Study the structure of the files: statistical unit, hierarchies,… Selection and filter of variables – Geographical level – Identifying variables (sex, age, place of residence, civil status, profession,...). – Sensitive topics (ideology, union membership, religion, beliefs, health). Risk analysis (Mu-Argus) Microdata protection techniques “Safe” microdata and metadata distribution 2.2 Methodology for the creation of microdata

2.3. Surveys analysed Survey on living conditions (ECV 2008) Survey on demographics and validation (EDV 2009) Survey on social capital (ECS 2010) Survey on environment - families (EMAF 2010) Survey on the information society - families (ESIF 2011)

Periodicity: five-year survey Type of survey: Sampling survey Statistical units: Families & individuals Sample size: families (and one individual per family) Objectives and information collected: To learn about the living conditions (health, education, work, free time, environment,…) of the Basque families and population. Survey on living conditions: creation of microdata

Structure of the microfile: – one file of families – one file of individuals – a key for the join is included Selection and filter of variables – Geographical level: quality and confidentiality criteria – Identifying variables Risk analysis Survey on living conditions: creation of microdata

Risk analysis: results Families file Individuals file Survey on living conditions: creation of microdata

Re-identification ratios Individuals file Families file Survey on living conditions: creation of microdata

Microdata protection techniques Global recoding Geographical level: Zone (groups of municipalities) Age: Five-year groups Top-Bottom coding Family size: Top-coded (10 or more). Number of rooms: Top-bottom coded (1-3 rooms, …, 7 or more) Filter of sensitive variables related to: Health, family income, economical restrictions, delinquency of the environment, participation in politics, interest in games of chance,… Survey on living conditions: creation of microdata

3. In situ access to researchers The aim: To provide a better service to researchers by permitting access to microdata in EUSTAT facilities under a rigorous security protocol. Protocol stages Request including information on the petitioner, objectives of the research project, people involved, detail description of the request and a work plan. Request authorisation/rejection based on the fulfilment of the requirements and purpose of the request (“scientific purpose”). Sign of a contract (confidentiality obligation, conditions of access,…) Access in EUSTAT centres : Software and hardware restrictions Check of the outputs

4. Future tasks Continue during the 2011 and 2012 with the creation of new microdata files (Labour Force Survey, Natural Population Movement, Survey on Family Conciliation... ) To offer in-situ access from the provincial offices in Bilbao and Donostia-San Sebastián and regard the possibility of Remote Access.

5. Conclusions The creation of microdata requires teamwork between methodologists, experts on protection techniques, and producers of statistics. Training is needed to extend all this know-how. The driving role of these types of transversal projects is indispensible, in our case this role is carried out by the Confidentiality Council integrated by the different departments of EUSTAT

Referencias Directive 95/46/EC of the European Parliament and of the Council of 24 October 1995 on The Protection of Individuals with regard to the Processing of Personal Data and on the Free Movement of such data. Basque Statistics Office - EUSTAT (1999) Statistical Data Protection Techniques. Technical notebook. Basque Statistics Office - EUSTAT (2007) Treatment of Confidentiality in EUSTAT statistical operations. Confidentiality protocol. Garín, A., Urrutia, J., (2000). Statistical Secret protection: basic elements of a data protection system. OFISTAT Seminar. National Institute of Statistics - INE (1994). Population and Households Census 1991: Methodology. ISBN: Madrid. Law 4/1986 of 23 April - Basque Statistical Law. Law 15/1999 of 13 December - Organic Law on Personal Data Protection. Statistical Programme Committee (2005) European Statistics Code of Practice and Commission Recommendations. Brussels.

Thanks for your attention!