1. Family Resources Survey Data Linking Jo Cockerham

2. Overview  Background  Uses of linked data  Development of consent question  Methodology  Match rates  Results from linked 2006/07 data  Future projects  Questions?

3. The Family Resources Survey  Launched in 1992 by DWP  26,000 private households in UK (about 24,000 in GB)  Detailed information on incomes and benefit receipt, tenure and housing costs, savings  Fieldwork carried out by ONS and NatCen

4. Background to data linking work  2004 Strategic Review of FRS  Problems with take-up statistics  Improvements to administrative data  New FRS contract from April 2006

5. Intended uses of linked data  Statistical and research purposes only  Improve the quality of FRS data  Longitudinal analyses – tracking how different groups move in and out of work and how their situation changes over time  Initially to only be made available internally at DWP and to selected HMRC analysts  Will not be used for operational purposes, such as fraud detection

6. Informed consent  Requires informed consent of respondent (Data Protection Act 1998)  Personal details need to be passed to DWP for linking (name, address, sex, date of birth – and NINO pre 2008)  Pilot study took place in 2006  Developed consent question which was introduced in November 2006

7. Features of 2006 consent question  Asked at end of questionnaire  Separate block to collect full name, address, NINO, date of birth  Written consent forms  Detailed wording  Proxy consent packs

8. Consent in 2006/07 FRS  Consent lower than anticipated  40 - 45 per cent for personal interviews  Approx 35 per cent including proxies  Known biases: –Consent rate lower among ethnic minorities –Consent falls slightly as age increases –Employees have higher consent than self-employed

9. Development of new consent question  Question suspended from August 2007  Resources diverted to development of improved question  Qualitative pilot October 2007  Quantitative pilot in January 2008

10. Qualitative pilot  30 in-depth interviews with respondents: split into 3 samples –Concluded that question needed to be simplified, more informal and required further clarification in the wording  Interviewer focus groups –Findings consistent with respondent interviews

11. Quantitative pilot Conducted in January 2008 main stage sample (1900 individuals) To test:  Achieved consent rate  Simplified version of the question  Removal of paper consent forms  Improved survey materials  Removal of NINO/collection of personal details as part of main questionnaire

12. 2008 pilot results  Consent rate rose to 62%  No bias between sub-groups  Leaflet received positive response  No difference between DWP and ONS consent  New question introduced from April 2008

13. Administrative data held by DWP  Despite low consent rate, useful analyses can be carried out.  The FRS has been linked to the Work and Pensions Longitudinal Study (WPLS).  500 million lines of data covering: –benefit claims –employment spells –annual earnings –savings –tax credits –pensions –operational data on customers activities (e.g. participation in back to work programmes).

14. FRSIDFRSID Personal DetailsFRS DATA FRS DATA – Dataset 1 FRSIDFRSID FRSIDFRSID Personal Details – Dataset 2 FRSIDFRSID FRSIDFRSID Personal Details ORCIDORCID ORCIDORCID FRSIDFRSID ORCIDORCID FRS DATA – for those giving consent to link FRS DATA ORCIDORCID WPLS ORCIDORCID FRS DATA Imputation, editing and DV creation on full FRS. FRS DATA - full release to users as in previous years Forward consenting cases to Data Matching team in DWP

15. Matching methodology  “Traffic lights” system  Staged approach by NINO, then surname (soundex), initial of forename, DoB, gender and postcode sector Match typeWhat matches GreenNINO plus 4 or 5 of the variables AmberNINO plus 3 of the variables RedNINO plus 2 of the variables No MatchNINO plus matches plus 1 or 0 of the variables

16. Matching methodology  Where match for NINO is not available, fuzzy matching by surname (soundex), initial of forename, DoB, gender and postcode sector Match typeWhat matches Green AmberAll 5 variables Amber Red4 variables, including DoB Red Amber4 variables, excluding DoB

17. Matching Rates 2006/07 data Match TypeNumber of casesPercentage Green441367.9 Amber70910.9 Red1892.9 No Match1352.1 Green Amber3124.8 Amber Red1632.5 Red Amber3936.0 No Record1852.8 Total6499100.0

18. Results from Linked Data: Savings  Savings/assets data on FRS criticised as unreliable i.e. underestimates people’s savings.  This can impact on high profile National Statistics. For example, figures on Pension Credit Take-Up.  Work carried out to assess the level of any under- reporting, compared the FRS to the HMRC data.  Several caveats: –sample size small –HMRC data covers fewer savings products than the FRS –HMRC data only available to 2004/5.

19. Savings Data Data Source MeanMedianNo of Ben Units MinimumMaximum FRS£39,511£13,422730£0£1,039,285 HMRC£51,476£22, 482730£44£1,059,245 Table below shows the comparison of the FRS measure with the FRS/HMRC measure of total capital HMRC figure is calculated using combination of FRS assets plus HMRC assets Where an HMRC account exists, they have higher/larger amounts in them Note: These figures are unpublished and should not be reproduced or quoted

20. Comparison of benefits  Only compared benefit spells which were live at the time of interview.  10 key benefits were examined.

21. Numbers claiming benefits Benefit TypeWPLSFRS Retirement Pension17651748 Pension Credit475371 Carer’s Allowance8470 Bereavement Benefit3431 Incapacity Benefit245221 Severe Disablement Allowance 4034 Disability Living Allowance422420 Attendance Allowance172141 Job Seekers Allowance10394 Income Support426389

22. Comparison of WPLS with FRS Benefit TypeOn BothOn WPLSOn FRS Retirement Pension17313417 Pension Credit35911612 Carer’s Allowance592511 Bereavement Benefit2863 Incapacity Benefit1885733 Severe Disablement Allowance 152519 Disability Living Allowance3705250 Attendance Allowance137354 Job Seekers Allowance86178 Income Support382447

23. Comparison of Benefit Amounts On BothOn One Source Benefit TypeWPLSFRSWPLSFRS Retirement Pension£94£96£90£81 Pension Credit£44£41£37£35 Carer’s Allowance£51£53£49£55 Bereavement Benefit£85£77£80£11 Incapacity Benefit£88£85£83£73 Severe Disablement Allowance£63£71£54£58 Disability Living Allowance£62£59£45£56 Attendance Allowance£53£50£54£47 Job Seekers Allowance£62£59£61£68 Income Support£78£73£77£113 Note: These figures are unpublished and should not be reproduced or quoted

24. Future Project Proposals  Investigating how benefits analysis may improve FRS validation  Rematch the data without using NINO to compare the quality of the match with/without NINO  Investigating how benefit mis-reporting affects total household income  Linking FRS earnings data to investigate how people are living on reported zero or low incomes  Comparison of FRS employment outcomes to data derived from P45 information

25. Questions ????