Measuring Interviewer Effects on Survey Error in SHARE Annelies Blom Julie Korbmacher Ulrich Krieger.

Slides:



Advertisements
Similar presentations
European Health Examination Survey. What is EHES? A health examination survey (HES) Includes both questionnaire and physical measurements Based on a random.
Advertisements

Filling in the Gaps in Administrative Data: Lessons from the Ticket to Work Evaluation Paul OLeary U.S. Social Security Administration October 2006.
1 4. Coordinating Modules & Layout. 2 A.A good introduction B.Choosing the order of modules C.Streamlining your instrument D.Question layout and formatting.
2003 Alabama Health Care Insurance and Access Survey Montgomery, AL May 2, 2003 Ashley Alvord, MPH Alabama Department of Public Health Children’s Health.
Protecting the Privacy of Family Members in Survey and Pedigree Research Jeffrey R. Botkin, MD, MPH University of Utah.
7.Implications for Analysis: Parent/Youth Survey Data.
Leader-Member Exchange Theory
Leader-Member Exchange Theory
Designing the Questionnaire
The Dual Tasks of Interviewers Ting Yan Colm O‘Muircheartaigh Jenny Kelly Pat Cagney Rebecca Jessoe NORC at University of Chicago Kenneth Rasinski University.
Survey Design Steps in Conducting a survey.  There are two basic steps for conducting a survey  Design and Planning  Data Collection.
NLSCY – Non-response. Non-response There are various reasons why there is non-response to a survey  Some related to the survey process Timing Poor frame.
Copyright © 2013 by Mosby, an imprint of Elsevier Inc. Importance of Health Assessment DSN Kevin Dobi, MS, APRN.
Measurement Validity and Reliability. Reliability: The degree to which measures are free from random error and therefore yield consistent results.
Questionnaire Design.
Perceptions of Concentrated Animal Feeding Operations (CAFOs) Presentation by Jeff S. Sharp OLC Annual Meeting & Industry Symposium Plain City, Ohio February.
Core Group Pan- European Network “Services for Supporting Family Carers of Elderly People in Europe: Characteristics, Coverage and Usage” E U R O F A M.
Survey Methods: Communicating with Respondents
1 Mapping China onto the International Landscape of Aging Studies James P. Smith.
Chapter 13 Survey Designs
Methodologic Overview of Two National Data Sets Centers for Disease Control and Prevention National Center for Health Statistics Issues in Comparing Findings.
FINAL REPORT: OUTLINE & OVERVIEW OF SURVEY ERRORS
Employer Health Benefit Survey Release Slides Tuesday, August 20, 2013.
Survey Perspective American Association for Public Opinion Research (AAPOR) Institute for Employment Research (IAB) Joint Program in Survey Methodology.
Surveying Volunteering: Giving in the Netherlands René Bekkers Center for Philanthropic Studies VU University Amsterdam.
Producing migration data using household surveys Experience of the Republic of Moldova UNECE Work Session on Migration Statistics, Geneva, October.
Exhibit 1. Continuously insured adults with private coverage or Medicaid rated the quality of their health care as excellent or very good at higher rates.
1 On cost efficiency - Tracking and tracing in the Norwegian EU-SILC Are the benefits from achieving one more respondents worth the effort? Bengt Oscar.
National Family Health Survey (NFHS-3), HIV Measurement Process and Prevalence.
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 13 Survey Designs.
1 SOURCES OF HEALTH AND CANCER INFORMATION by Lilnabeth P. Somera SESSION: Joining Forces through Social Media World Cancer Congress Melbourne, Australia,
Workshop on Health Examination Surveys (HES) Legal and ethical issues Susanna Conti, M. Kanieff, G. Rago Istituto Superiore di Sanità (ISS) (National Public.
Cognitive Interviewing for Question Evaluation Kristen Miller, Ph.D. National Center for Health Statistics
1 International Comparative Data for Research and Policy on Aging James P. Smith.
1 Understanding Health, Ageing and Retirement in Europe Prof. Axel Börsch-Supan, Ph.D. Director, Mannheim Research Institute for the Economics of Aging.
TEMPLATE DESIGN © The Homework Effect: Does Homework Help or Harm Students? Katherine Field EdD Candidate, Department.
Chapter 12: Survey Designs
Coding Compliance Plan July 12, Benefits of a compliance program  To demonstrate our commitment to honest and responsible conduct, decrease the.
Institute for School Development Research (IFS) Researching the influence of educational policy on school- and teaching quality – The European Collaborative.
European Health Examination Survey Hanna Tolonen, PhD EHES Project Manager.
GAMIAN-Europe Pan European Stigma Study Presented by Elaine Brohan 2 nd November 2007 Principal Investigators: Prof Graham Thornicroft, Mr Rodney Elgie.
PPA 502 – Program Evaluation Lecture 2c – Process Evaluation.
Assessing the prevalence of violence against women in Canada Heather Dryburgh, Ph.D. Statistics Canada Presented on behalf of Holly Johnson, Ph.D.
The Challenge of Non- Response in Surveys. The Overall Response Rate The number of complete interviews divided by the number of eligible units in the.
Building Wave Response Rates in a Longitudinal Survey: Essential for Nonsampling Error Reduction or Last In - First Out? Steven B. Cohen Fred Rohde and.
Adding a Biosocial Component to Understanding Society Research Methods Festival Session 56 – Understanding Society July 2010 Stephanie McFall.
Marketing Research Approaches. Research Approaches Observational Research Ethnographic Research Survey Research Experimental Research.
3.14 X AXIS 6.65 BASE MARGIN 5.95 TOP MARGIN 4.52 CHART TOP LEFT MARGIN RIGHT MARGIN ©TNS 2013 Are ‘better’ interviewers more successful at.
Marketing Research Process and Types of Marketing Research.
MT 219 Marketing Unit Three Global Marketing and Consumer Behavior Note: This seminar will be recorded by the instructor.
Regulations 201: Thorny Issues What is Research? Exempt and Expedited Reviews.
TRAINING COURSE. Course Objectives 1.Know how to handle a suspected case 2.Know how to care for a recognized trafficked person referred to you Session.
2012 National Conference on Health Statistics Jacqueline Wilson Lucas, B.A., M.P.H., National Center for Health Statistics Division of Health Interview.
1 Chapter 13 Collecting the Data: Field Procedures and Nonsampling Error © 2005 Thomson/South-Western.
Introduction to research
Marketing Research Aaker, Kumar, Day Ninth Edition Instructor’s Presentation Slides.
Taiwan Longitudinal Study on Aging (TLSA)
Copyright © 2008 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved. John W. Creswell Educational Research: Planning,
Survey Design Interviewing STAT 472. The Role of the Interviewer Interviews to gather information occur in many settings (Employers interview prospective.
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 13 Survey Designs.
WORK EXPERIENCE INDEPENDENT PLACEMENTS. Who are we? We are an independent charity that has been organising work related learning activity since 1993 We.
An Introduction to The Gateway to Global Aging Data Webinar April 12 th, 2016 Drystan Phillips.
Johan Mouton© February 2006 C Hart Exploratory questions What are the most important variable that have an effect on learner achievement? What happens.
Client Screening & Fitness Assessment
Aaker, Kumar, Day Seventh Edition Instructor’s Presentation Slides
Section 1: What are longitudinal studies?
Chapter Nine Marketing Research Professor Charles Trappey
Interviewing Process.
Multi-Mode Data Collection
Presentation transcript:

Measuring Interviewer Effects on Survey Error in SHARE Annelies Blom Julie Korbmacher Ulrich Krieger

Motivation  Korbmacher and Schröder (2010): consent to record linkage (SHARE wave 3) „The decision making process is mainly influenced by the interview situation which in turn is driven by the interviewer-respondent-interaction ”

The role of the interviewer  …make contact  …gain cooperation  …ask survey questions  …conduct measurements  …record answers and measurements  …maintain respondents’ motivation throughout the interview Standardized interviews to reduce variation in the entire data collection process

Types of interviewer effects in surveys Interviewer Measurement Unit nonresponse ContactCooperation Item nonresponse Nonresponse- Error Measurement- Error

Survey of Health, Ageing and Retirement in Europe (SHARE)  Multidisciplinary  Micro data on health, socio-economic status, social and family networks  bi-annual, longitudinal (wave 1 in 2004)  20 European countries  SHARE-DE (Wave 4) specials:  Record linkage (Pilot in wave 3)  Collecting biomarkers  Nonresponse experiment

Interviewer effects examined in SHARE Germany Wave 4 Interviewer Income item nonresponse Consent to biomarkers  blood pressure  height  waist circumference  dried blood spots Unit nonresponse (incentives)  No unconditional incentive  10€ unconditional incentive  20€ unconditional incentive  40€ unconditional incentive Consent to record linkage

Measuring and Explaining interviewer effects  Step 1: Measuring interviewer effects  Step 2: Explaining interviewer effects  Who are the SHARE interviewers?  Interviewer questionnaire  Underlying assumptions:  Interviewers differentially impact on the data collection process  This differential impact is related to their – conscious and subconscious – appearance and actions  These actions can be explained by characteristics collected in an interviewer survey

Interviewer survey  2011  Interviewer Training Wave 4 (trained 197 interviewers)  Paper-and-pencil  Voluntary and no incentives  At the end of the training session  Response rate: 83%  Link via InterviewerID to SHARE Survey data!

Conceptual framework  4 dimensions of interviewer characteristics Unit non- response Unit non- response (incentives) Consent to biomarker collection Consent to record linkage Item nonresponse (income) General attitudes Own behavior Experience with measurements Expectations  5 aspects of SHARE Wave 4 (Germany)

Conceptual framework  General interviewer attitudes  Reasons for being an interviewer  Attitudes towards best practice  Trust and data protection concerns  Interviewers‘ own behavior  Interviewer as respondents  Membership in social networks  Income  Blood donation  Hypothetical questions:  disclose sensitive information  consent to record linkage  consent to biomarkers

Conceptual framework  Interviewers’ experience with measurements  Conducting standardized interviews  SHARE  Conducting blood sugar tests  Interviewers’ expectations of unit response, consent and item response rates  Expected response and consent rates:  Different incentive groups  Biomarker measurements  Record linkage  Income

Some results of the interviewer survey  Nonresponse Interviewers were confident that the higher the value of the incentive the more successful they would be in recruiting respondents. Interested in learning about the lives of other people Important to work on research that is relevant to society expect higher RRs expect lower RRs Using of social networks (facebook)

Some results of the interviewer survey  Consent to record linkage  Expected consent rate: 59,2%  Interviewers who would reveal personal information expect a significantly higher consent rate.  SSN  Telephone number  Private Address  Address of health insurer

Some results of the interviewer survey  Interviewers who would consent to data linkage expect a significantly higher consent rate.  Credit history  Employment history  Medical records  Social benefits  Interviewer who are part of social networks expect significantly lower record linkage rates.

Outlook  Next steps:  Completion of the survey  Linking with SHARE survey data to learn more about interviewer effects  Can we explain interviewer effects in SHARE with the interviewers’ characteristics allocated in the interviewer survey?