Capturing Sensitive Data & Data Linkage. Capturing Sensitive Data Data Protection Act 1998 (Section 33) – Allows data to be used for research purposes.

Slides:



Advertisements
Similar presentations
Wisconsin Department of Health Services Richard Miller Research Scientist Wisconsin Office of Health Informatics October 28, 2014 Matching Traffic Crash.
Advertisements

Data Sharing and Linking Service Overview presentation May 2013.
Using Administrative Data to Improve Social Statistics – An Example of Collaborative Work Minda Phillips, Office for National Statistics. Paul Sinclair,
Dr Gordon Russell, Napier University Unit Data Dictionary 1 Data Dictionary Unit 5.3.
Using synthetic data to improve the accessibility of the SLS Susan Carsley, SLS Project Manager.
Counting the Dutch, The Future of the Virtual Census in the Netherlands Presentation at the seminar Counting the 7 Billion 24 February 2012 * Geert Bruinooge.
SCOTXED FORUM Data Matching and Developments Pete Whitehouse.
March 2013 ESSnet DWH - Workshop IV DATA LINKING ASPECTS OF COMBINING DATA INCLUDING OPTIONS FOR VARIOUS HIERARCHIES (S-DWH CONTEXT)
Publishing qualitative studies H Maisonneuve April 2015 Edinburgh, Scotland.
Data Management Awareness January 23, University of Michigan Administrative Information Services Data Management Awareness Unit Liaisons January.
The Dutch Censuses of 1960, 1971 and 2001 Producing public use files in the IPUMS project Wijnand Advokaat Statistics Netherlands Division Social and Spatial.
Topic 7 Sampling And Sampling Distributions. The term Population represents everything we want to study, bearing in mind that the population is ever changing.
The Practice of Statistics
Aim of paper To investigate teachers’ perceptions on the role that teachers’ associations play in their professional development, with reference to the.
The phases of research Dimitra Hartas. The phases of research Identify a research topic Formulate the research questions (rationale) Review relevant studies.
Chapter 4 Demographic Data. Chapter Outline Sources Of Demographic Data Population Censuses Registration Of Vital Events Combining The Census And Vital.
Immigration in the context of MBIE’s wider policy goals and objectives Pathways Conference, 23 July 2015 Stephen Dunstan GENERAL MANAGER, SERVICE DESIGN.
1 1 General preconditions Training workshop on ¨censuses using administrative registers in Geneva 21 May 2012 Harald Utne, Statistics Norway
Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September 2011 Overview of Archiving of Microdata Session 4 United Nations.
Reporting & Ethical Standards EPSY 5245 Michael C. Rodriguez.
Copyright 2010, The World Bank Group. All Rights Reserved. Integrating Agriculture into National Statistical Systems Section A 1.
Dutch Virtual Census Presentation at the International Seminar on Population and Housing Censuses; Beyond the 2010 Round November, 2012 Egon Gerards,
NSI/ISI Statistical software Issues and a way forward to maximise re-use and minimise integration efforts by Andrea Toniolo Staggemeier.
IB Psychology Internal Assessment Guide - Introduction
12th Meeting of the Group of Experts on Business Registers
1 Areas of Current Study and FDA’s Strategic Direction Relative to Retail Food Safety.
List frames area frames and administrative data, are they complementary or in competition? Elisabetta Carfagna University of Bologna Department of Statistics.
Record matching for census purposes in the Netherlands Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics Netherlands.
Professional Values and Basic Business Legislation.
Medical Informatics Patient Administration System.
Sponsorship on Standardisation Main results Barteld Braaksma, Cecilia Colasanti, Piero Demetrio Falorsi, Wim Kloek, Miguel Angel Martínez Vidal, Jean-Marc.
The Children’s Data Network: An Update… September 2, 2015.
Metadata Models in Survey Computing Some Results of MetaNet – WG 2 METIS 2004, Geneva W. Grossmann University of Vienna.
Triangulation between commercial and administrative sources Workshop of the DUG Conference on 8 th October 2009.
Assessing Disclosure for a Longitudinal Linked File Sam Hawala – US Census Bureau November 9 th, 2005.
What is personal data? Personal data is data about an individual which they consider to be private.
Interstate Statistical Committee of the Commonwealth of Independent States (CIS-Stat) WAYS AND MEANS OF IMPROVING THE QUALITY OF MIGRATION STATISTICS:
Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education.
Access to microdata in Statistics Estonia First DwB European Data Access Forum Luxembourg, 28th March 2012 Tuulikki Sillajõe.
Creating Open Data whilst maintaining confidentiality Philip Lowthian, Caroline Tudor Office for National Statistics 1.
©2011 1www.id-book.com Data Gathering Chapter 7. ©2011 Data Gathering What is data gathering? –The act of gathering data through a study The data can.
ISO/IEC 27001:2013 Annex A.8 Asset management
Objectives Understand Corrective, Perfective and Preventive maintenance Discuss the general concepts of software configuration management.
24 Nov 2007Data Management and Exploratory Data Analysis 1 Yongyuth Chaiyapong Ph.D. (Mathematical Statistics) Department of Statistics Faculty of Science.
The 2011 Census: Estimating the Population Alexa Courtney.
Joint UNECE/Eurostat work session on statistical data confidentiality October 2015 Helsinki, Finland Circle of trust Maurice Brandt DESTATIS.
Copyright 2010, The World Bank Group. All Rights Reserved. Core and Supplementary Agricultural Topics Section A 1.
Beyond 2011 Voluntary Sector Statistics User Event Minda Phillips Amelia Ash.
The Troubleshooting Process. Hardware Maintenance Make sure that the hardware is operating properly.  Check the condition of parts.  Repair or replace.
Challenges in data linkage: error and bias
Implementation of Quality indicators for administrative data
Ensuring Data Quality for Monitoring and Evaluation
Information Assurance Policy and Management
Constructing hypotheses & research design
Unit 6 Research Project in HSC Unit 6 Research Project in Health and Social Care Aim This unit aims to develop learners’ skills of independent enquiry.
Patient Medical Records
Tennessee Longitudinal Data system (TLDS)
What is Administrative Data?
The Public Sector Equality Duty
Data Quality By Suparna Kansakar.
Sabrina Iavarone Senior User Services Officer
Metadata in the modernization of statistical production at Statistics Canada Carmen Greenough June 2, 2014.
D3 Confidentiality.
Research Methods in Education Session 7
Test Security.
The Public Sector Equality Duty
The role of metadata in census data dissemination
DRAFT ISO 10007:2017 Revision Overview Quality management – Guidelines for configuration management ISO/TC176 TG 01.
OBSERVER DATA MANAGEMENT PRINCIPLES AND BEST PRACTICE (Agenda Item 4)
Presentation transcript:

Capturing Sensitive Data & Data Linkage

Capturing Sensitive Data Data Protection Act 1998 (Section 33) – Allows data to be used for research purposes The Information Commissioner - data collected for National Statistics and educational research can include identifiable items.

Capturing Sensitive Data Maximise the quality and value of information gained from single sources Enhance user’s understanding of statistical information Efficient collection of data (value for money) Provide opportunities for the cross-analysis, exchange and re-use of data

Data Linkage Project

Existing Data Linkage School Leaver Destinations – Destination of leavers from publicly funded schools (Careers Scotland) Pupil characteristics taken from the September Pupil Census

Data Linkage Project Aims Maximise the value of available administrative data and system Relate significant events that are remote from one another in time or location Facilitate the widespread and safe use of matched education data To establish as quickly, cheaply and accurately as possible which education related records belong to the same individual.

Investigate the data collected (quality and consistency) Design/redesign administrative systems to allow integration and data sharing. Standard definitions, names and codes Standard geographies National (and international) standards

Matching Techniques…... Exact matching leads to inexact results e.g. requiring exact match on SCN, date of birth, sex - expect at least 10-15% errors because of discrepancies Probability matching more accurate Quantifies the implications of levels of agreement and disagreement 2% true links missed

Development of the linkage methodology Why use Probability Matching ?

Areas for consideration Data Investigation and Data Cleaning Bring together the pairs of records to be compared (‘Blocking’) Linkage methodology Reporting and Refinement Anonymisation

Data Protection, Confidentiality and Security Access to person identifiable data Defined procedures for the secure handling of sensitive data Organisational protocols Access & storage Formal application Impose Conditions (anonymisation)

Project Summary Proof of concept Data available for linkage Linkage methodology Conclusions and results