Presentation is loading. Please wait.

Presentation is loading. Please wait.

Validation, editing and imputation of the Family Resources Survey John Snow (DWP) Family Resources Survey ESDS Government FRS User Meeting April 2008.

Similar presentations


Presentation on theme: "Validation, editing and imputation of the Family Resources Survey John Snow (DWP) Family Resources Survey ESDS Government FRS User Meeting April 2008."— Presentation transcript:

1 Validation, editing and imputation of the Family Resources Survey John Snow (DWP) Family Resources Survey ESDS Government FRS User Meeting April 2008

2 Overview of FRS Processing ONS/NatCen Validation Editing the data Imputation Grossing Data release Family Resources Survey Derived Variables

3 Validation - Hierarchical Data Structure Family Resources Survey

4 Validating the data Data Validation – Initial checks (Year start) ­Documentation: metadata / One True Version (OTV) ­Check all new variables ­Check changes to variables (eg labels) ­Additional changes (eg routing) Family Resources Survey

5 Validating the data Data Validation – monthly checks ­Record creation ­General validation Set Type checks Skipped key variables Skipped important variables Family Resources Survey

6 Editing the data 1 Benefit Editing ­Near Zero Amounts ­Near identical ­Single / Multiple Benefits ­Combined Benefits Family Resources Survey

7 Editing the data 2 Pre-imputation editing ­Outliers – now run by ONS – 6 monthly ­Credibility Checks – now run by ONS ­Weekly amounts (Period codes) Post-imputation & DVs editing ­Credibility Checks – run by DWP Family Resources Survey

8 Imputation What is Imputation? ­To estimate missing values on item non response Why / when do we impute? How to impute, and checks? ­Algorithms ­Hotdecking ­Bias Family Resources Survey

9 Derived Variables What are Derived Variables (DVs)? ­Customised variables (Note: some created by ONS (eg DVMARDF) ­Created on data users request ­Used to carry out consistent analysis ­Regularly reviewed Family Resources Survey

10 Grossing What is Grossing? ­A factor which is applied to the sample data to give estimates which represent overall population. ­Control totals are applied, for males and females by age-band, by region ­Other control totals are number of lone parents, tenure type and Council Tax band Family Resources Survey

11 Releasing the data Within DWP: FRS Main Dataset ­Across analytical directorate Outside DWP: FRS Anonymised Dataset - Other Government Departments - Researchers via the UK Data Archive Family Resources Survey

12 Terms & Conditions for Using the FRS The dataset will be used for secondary analysis in the form of tabulations and statistical modelling - Outputs will not be produced that are likely to identify an individual -Regional results should not to be published below Government Office Region (GOR) If in doubt please contact the FRS team at DWP (team.frs@dwp.gsi.gov.uk) Family Resources Survey

13 Annual FRS Publication The Annual FRS Publication latest... 2005-06; released on 27 March 2007 available online Family Resources Survey

14 Outside Government Benefit Take-Up Households Below Average Income UK Data Archive New Policy Institute Government DWP Pensioner Incomes Policy Simulation HMT HMRC DTI Scottish Executive Disability and Carers WWEG, PCD… Pensions Commission Defra DfES Europe : LIS Institute of Fiscal Studies The FRS Community Northern Ireland, DSD Family Resources Survey Family Poverty & Work ONS

15 For further help… IFD IM1 Phone Maxine Willitts(Team Leader: General, Data Release, report) (020) 7962 8092 Jeremy Barton (Harmonisation, Methodology, Analysis)(020) 7962 8991 John Snow (Imputation, Derived Variables)(020) 7962 8946 Robert Chung(Benefit Editing, Data Access)(020) 7962 8731 Any questions? Family Resources Survey


Download ppt "Validation, editing and imputation of the Family Resources Survey John Snow (DWP) Family Resources Survey ESDS Government FRS User Meeting April 2008."

Similar presentations


Ads by Google