Data cleaning workshop Berlin, 8-10 June 2009 The Analysis of Interviewers‘ remarks Laura Crespo Spanish team CEMFI.

Slides:



Advertisements
Similar presentations
SURVEY QUALITY CONTROL
Advertisements

MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Survey Quality Control.
Introduction to UIS data collection tools and guidelines South East Asian Regional Workshop on Science, Technology and Innovation Statistics.
Conducting the Interview/Survey
UNESCAP Project on Disability Statistics Field testing protocol.
© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Business Surveys – Testing Strategies in.
Measuring Interviewer Effects on Survey Error in SHARE Annelies Blom Julie Korbmacher Ulrich Krieger.
Data Validation Documentation for Enrollments. Learning Objectives As a result of this training you will be able to: Describe the data validation process.
NLSCY – Non-response. Non-response There are various reasons why there is non-response to a survey  Some related to the survey process Timing Poor frame.
Questionnaire Design.
Community Passport Project Idaho Office for Refugees November 2010.
Developing a Questionnaire. Goals Discuss asking the right questions in the right way as part of an epidemiologic study. Review the steps for creating.
THE UNIVERSITY OF MISSISSIPPI The University of Mississippi Institute for Advanced Education in Geospatial Science Census to American Community Survey.
1 MTN-003 Training General Interviewing Techniques Some specific tips for administering the Screening interviewer-administered CRFs SSP Section 14.
Throckley Primary Care Results of Patient Information Survey
107 Findings and Follow-up Referral ** Initial Contact **
Arun Srivastava. Types of Non-sampling Errors Specification errors, Coverage errors, Measurement or response errors, Non-response errors and Processing.
Documentation Waleed Al-Shehri,BSc.PT King Saud university College of applied Medical Science Rehabilitation Science Department Physical Therapy.
1 WORLD TOURISM ORGANIZATION (UNWTO) MEASURING TOURISM EXPENDITURE: A UNWTO PROPOSAL SESRIC-UNWTO WORKSHOP ON TOURISM STATISTICS AND THE ELABORATION OF.
EMPLOYMENT QUALITY INDICATORS. NATIONAL DEFINITIONS AND DATA SOURCES MAY CHANGE A LOT. CENTRAL STATISTICAL OFFICE POLAND Radoslaw Antczak | Geneve,
Fourth Joint EU-OECD Workshop on Business and Consumer Opinion Surveys EU-wide business survey in the financial service sector Brussels, 12th October 2009.
Copyright 2010, The World Bank Group. All Rights Reserved. Testing and Documentation Part I.
American Community Survey ACS Content Review Webinar State Data Centers and Census Information Centers Gary Chappell ACS Content Review Project Lead April.
SHARE data cleaning meeting Frankfurt – December, 6 Some suggestions from the Italian experience Paccagnella Omar Omar Paccagnella Data cleaning meeting.
Grundtvig 2 Project Learning Partnership. D ESIGNING I NCLUSIVE S PORT A CTIVITIES F ACILITIES Questionnaire for Services Providers.
Use of survey (LFS) to evaluate the quality of census final data Expert Group Meeting on Censuses Using Registers Geneva, May 2012 Jari Nieminen.
Questionnaire administration EHES Training material.
Mannheim Research Institute for the Economics of Aging SHARE IDs Stephanie Stuck MEA Frankfurt December 6 th.
Mannheim Research Institute for the Economics of Aging Data Cleaning Process Patrick Bartels MEA Frankfurt, December 6 th.
Copyright 2010, The World Bank Group. All Rights Reserved. Data Processing and Tabulation, Part I.
Register-Based Census 2011 in Slovenia – Some Quality Aspects Danilo Dolenc Statistical Office of the Republic of Slovenia UNECE-Eurostat Expert Group.
Harmonisation across countries in SHARE Workshop on Harmonisation of Social Survey Data for Cross-National Comparison Prague 19.
1 SHARE Pretest 2010 Feedback & Results. 2 Schedule.
Laura Crespo SHARE Meeting on Data Cleaning The Analysis of Interviewers’ Remarks Laura Crespo Spanish Team CEMFI Frankfurt December 6, 2007.
Data collection on discrimination complaints Developing an Equinet data collection template on com- plaints to quasi-judicial equality bodies Barbara Liegl.
CONSULTATION SKILLS Dr. Ekram A Jalali.
Jibby Medina & Kelly Ward CLEANING THE ELSA LIFE HISTORY INTERVIEW.
AADAPT Workshop South Asia Goa, December 17-21, 2009 Maria Isabel Beltran 1.
Survey Design and Data Collection Most Of the Error In Surveys Comes From Poorly Designed Questionnaires And Sloppy Data Collection Procedures.
United Nations Statistics Division Registry of national Classifications.
TASK 1.10.DOCUMENTATION OF THE PROBLEMS FACED DURING EHIS WAVE 1 BRIEF SUMMARY OF PROBLEMS OCCURED DURING EHIS WAVE 1 EHIS WORKSHOP, BERLIN SEPTEMBER 30.
Improving the Quality of the HMRC Personal Wealth Statistics Rebecca Ambler and Abeda Malek - HMRC.
The Challenge of Non- Response in Surveys. The Overall Response Rate The number of complete interviews divided by the number of eligible units in the.
Post enumeration survey in the 2009 Pilot Census of Population, Households and Dwellings in Serbia Olga Melovski Trpinac.
Mannheim Research Institute for the Economics of Aging SHARE Data Cleaning Stephanie Stuck MEA Vienna November 5/6 th.
By: Dr. AWATIF ALAM ASSOCIATE PROFESSOR MEDICAL COLLEGE,KSU.
9/23/13.  Transcript Request Notebook  College Days  Career Day  College Cards  Financial Aid info meeting TONIGHT at 6 pm  Local Scholarships 
1 SIPP IMPUTATION SCHEME AND DISCUSSION ITEMS Presenters: Nat McKee - Branch Chief Census Bureau Demographic Surveys Division (DSD) Income Surveys Programming.
Assessing Reproductive Health Needs After Disasters Interview Training.
Copyright 2010, The World Bank Group. All Rights Reserved. Testing and Documentation Part II.
Data Cleaning in Financial Modules Workshop in Frankfurt Mario Schnalzenberger.
United Nations Workshop on Evaluation and Analysis of Census Data, 1-12 December 2014, Nay Pyi Taw, Myanmar DATA VALIDATION-I Evaluation of editing and.
TIMOTHY SERVINSKY PROJECT MANAGER CENTER FOR SURVEY RESEARCH Data Preparation: An Introduction to Getting Data Ready for Analysis.
Regulations 201: Thorny Issues What is Research? Exempt and Expedited Reviews.
Training on occupational classifications. Name of the presentation Introduction ISCO 08 has started to be implemented in the EU countries in several social.
Data Cleaning and Imputation Imputation done on economic variables (assets, income, consumption, financial transfers, health expenses), education, self-reported.
© Statistisches Bundesamt, VI A Statistisches Bundesamt The new method of the next german Population census Johann Szenzenstein, Federal Statistical Office,
Session Session EDE Technical Reference Document Review and Layout Changes.
Outliers with „natural limits“ SHARE Data Cleaning Workshop Berlin, June 2009 Sabrina Zuber.
The Cognitive Survey for Mauritius – test and results Presented by: Mr Chettun Kumar ARIANAICK Statistician.
SHARELIFE Meeting Vienna – November, 5-6 The Italian experience in SHARE data cleaning Paccagnella Omar Omar Paccagnella SHARELIFE meeting November 6,
Monday, June 23, 2008Slide 1 KSU Females prospective on Maternity Services in PHC Maternity Services in Primary Health Care Centers : The Females Perception.
Strategies for Engagement By Tammy Guest, MA Oregon Supported Employment Center for Excellence.
© Take Charge America Institute – September 2008 – Workshop Guide – Understanding Credit Reports Advanced Funded by a grant from Take Charge America, Inc.
ESL, Immigrant, and Homeless Populations Updated 2/22/16 Identifying Special Populations & Coding in EIS.
Mixed Basket A WIC in-service in 4 parts June 2016.
WORK DISABILITY EVALUATION IN SLOVENIA EVA KOSTA, MSc, MD The Institute of Pension and Disability Insurance of Slovenia Board of Medical Assessors.
State of play: data transmission, validation and dissemination
Presentation transcript:

Data cleaning workshop Berlin, 8-10 June 2009 The Analysis of Interviewers‘ remarks Laura Crespo Spanish team CEMFI

 This is based on my presentation for Wave 2 in Frankfurt, December :  Based on the remarks and feedback from PL, NL, BE-fr, DK, GR and ES from Wave 2 !  Comments and suggestions from other countries’ experiences are very welcome! SHARE Data Cleaning Workshop

Reminder: When a “remark” should be recorded?:  When a response (or non-response) needs to be commented.  When Blaise does not accept the answer provided by the respondent.  When a response is difficult to code.  When a response needs to be clarified. SHARE Data Cleaning Workshop

 Therefore, Good news:  They may contain very useful info for data cleaning (and also useful for SHARE-users, working-groups, country teams and even the survey agency).  They are an important source of info to detect errors, missing info, clarifications, problems with questions. One of the first things to look into. Bad news:  Very iwer-specific (large heterogeneity across iwers, questions, and even countries).  They need a case-by-case analysis. Very time consuming.  At some point, they will need translation to english. SHARE Data Cleaning Workshop

Dealing with iwer remarks: Steps Step 1: They will be provided by MEA in an Excel file with a particular format for categorization. Step 2: Have a look at them and try to define specific categories based on their content and potential use. Very often we will need to check the corresponding question to understand perfectly the remark. Categories: 1. Remarks that should be investigated for data cleaning. 2. Useful remarks for researchers, working groups or country teams. 3. Both (useful for data cleaning and SHARE users). 4. Other remarks that should be investigated. SHARE Data Cleaning Workshop

Step 3: Focus on those that may be useful for data cleaning and identify which correction should be made. Step 4: Write programs to correct data or flag cases following instructions (examples do files from wave 1 and wave 2 provided by MEA?) Dealing with iwer remarks: Steps SHARE Data Cleaning Workshop

Step 2) Categories with different colours/columns 1. Remarks that should be investigated for data cleaning:  Specific amounts, frequencies, years, time periods (time consistency along the calendar or life cycle).  Currencies (maybe less problematic than in Wave 2).  Gross terms instead of net terms or viceversa. SHARE Data Cleaning Workshop

Remarks for data cleaning  Answer category: Information that may be recorded or imputed to one of the categories already defined (instead of “Other” option) or should be back-checked with the reported answer: –(RC) Sources of income maternity leave. –(RP) Reasons for not living with a partner. –(AC) Type of residence. –(RE) Situation at 15 if no education, occupation (ISCO), economic activity (NACE), why worked part-time, reasons left job, title of the job. –(GS) reasons for no completed, positions during the tests. –(HS) Type of illness, reasons for no checks. –(IV) location and type of house SHARE Data Cleaning Workshop

Remarks for data cleaning  Answer category: Information that may be recorded or imputed to one of the categories already defined (instead of “Other” option) or should be back-checked with the reported answer: –(EP) employment status, pensions, eligibility for pensions, occupation (ISCO), economic activity (NACE). –(HO) housing status. –(HC) health care payments. –(GS, WS, PT) positions during the tests. –(CH) age of children, education. –(DN) marital status. –(PH) illness and disorders, medication, surgery… –(IV) location and type of house SHARE Data Cleaning Workshop

 Mistakes by iwers when coding the answers or the proxy status.  The system does not accept a particular answer (i.e, years, dates, amounts).  Corrected information that is included by the iwer when the respondent realizes that he/she made a mistake or reported wrong info previously (specially when inconsistencies are detected along the calendar). Remarks for data cleaning SHARE Data Cleaning Workshop

1. Remarks useful for researchers, working groups or country teams:  Grip strength test not performed or interrupted due to illness, disabilities, fears, concerns, not safe.  Problems encountered during the physical test (due to distraction, lack of concentration or interest, nerves, specific physical impairments or conditions,..). Presence of another person during the test.  Does not remember/Does not Know.  Does not know to read or write. Remarks for data cleaning SHARE Data Cleaning Workshop

 Difficulties with Spanish (language problems).  IWERS' opinions about the reliability of the answers: contradictions, attitudes, random answers, reluctance…  Further clarifications or explanations of reported answers.  i.e., help (or influence) provided by another person (spouse, children, others,…)  Problems or circumstances with the drop-offs (help provided by the iwer, by a relative,…). Remarks for data cleaning SHARE Data Cleaning Workshop

 More specific motives for non-response (private and sensitive information, does not understand the question): i.e., stillborn children, no available equipment to perform tests.  Complaints relating to the length of questionnaire. Remarks for data cleaning SHARE Data Cleaning Workshop

3. Both (useful for data cleaning and SHARE users):  Use of proxies (need to be back-checked with SMS data and also useful for researcher). 4. Other remarks that should be investigated:  Unclear meaning.  Phone numbers and addresses (may be important for contacts in next waves). Some examples. Remarks for data cleaning SHARE Data Cleaning Workshop

Step 3: Focus on remarks for data cleaning and identify the correction needed. Step 4: Corrections (do files):  Instructions on this?  Even if a correction or imputation can not be made, the remark could still be useful for SHARE users, working groups/country teams and CentERdata (revision of questionnaire for Wave4).  Production of a specific file with translation for this purposes?  Translation of all remarks: Probably not worthy! Remarks for data cleaning SHARE Data Cleaning Workshop

Thanks for your attention! Julie’s instructions Open discussion… Remarks for data cleaning SHARE Data Cleaning Workshop