Survey Perspective American Association for Public Opinion Research (AAPOR) Institute for Employment Research (IAB) Joint Program in Survey Methodology.

Slides:

Advertisements

Similar presentations

Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?

Advertisements

The English Longitudinal Study of Ageing (ELSA) Data & Documentation 2008 Jibby Medina NatCen.

Lecture 2: Types of Studies, Target Populations, & Ethical Concerns

Methods of Economic Investigation Lecture 2

Weighting Methodology for the Private Landlords Survey Robert Bucknall, ONS.

Chasing hard to get cases in panel surveys – is it worth it? Nicole Watson, University of Melbourne Mark Wooden, University of Melbourne.

Predictors of Emergency Department Utilization by Homeless Persons: A National Study Clarilee Hauser PhD, RN.

Structured Survey Interviewing: Telephone and In-Person Surveys Behice Ece Ilhan Chihchien Chen.

TERRITORIAL FUNCTIONING AND VICTIMISATION IN COUNCIL ESTATES IN SHEFFIELD By: Aldrin Abdullah.

Measuring Interviewer Effects on Survey Error in SHARE Annelies Blom Julie Korbmacher Ulrich Krieger.

NLSCY – Non-response. Non-response There are various reasons why there is non-response to a survey  Some related to the survey process Timing Poor frame.

Chapter 7 Sampling Distributions

Measurement Validity and Reliability. Reliability: The degree to which measures are free from random error and therefore yield consistent results.

Quantitative methods for researching lives through time Heather Laurie Institute for Social and Economic Research University of Essex

Examining Gender Bias in Studies of Innovation By: Nicola Crowden Innocom Conference October , 2003.

Bridging the Gaps: Dealing with Major Survey Changes in Data Set Harmonization Joint Statistical Meetings Minneapolis, MN August 9, 2005 Presented by:

Social Determinants of Mental Health: Contributions ? John Cairney Health Systems Research Unit Centre for Addiction and Mental Health Department of Psychiatry.

1 Lynn A. Blewett, Ph.D. Assistant Professor Tracy L. Johnson, Ph.D. President, Health Policy Solutions Adjunct Faculty, University of Colorado Timothy.

Curating and Managing Research Data for Re-Use Review & Processing Jared Lyle.

Copyright 2010, The World Bank Group. All Rights Reserved. Estimation and Weighting, Part I.

Where Do Data Come From? ● Conceptualization and operationalization of concepts --> measurement strategy --> data. ● Different strategies --> different.

Volunteer Angler Data Collection and Methods of Inference Kristen Olson University of Nebraska-Lincoln February 2,

8.Implications for Analysis: School Survey, Student Assessment, and Transcript Data.

12th Meeting of the Group of Experts on Business Registers

Staying the Course: Facility and Profession Retention among Nursing Assistants in Nursing Homes Sally C. Stearns, PhD Laura D’Arcy, MPA The University.

 Increasing age was associated with more time in sleep & leisure, & less in productive activity.  Females averaged less time in leisure & more time in.

Statistics Networking Day Question design Jacki Schirmer Senior Research Fellow Health Research Institute & Institute for Applied Ecology

Living arrangements, health and well-being: A European Perspective UPTAP Meeting 21 st March 2007 Harriet Young and Emily Grundy London School of Hygiene.

Challenges in Collecting Police-Reported Crime Data Colin Babyak Household Survey Methods Division ICES III - Montreal – June 20, 2007.

High cost placements Peter McGill and Jo Poynter.

Chap 1-1 Statistics for Managers Using Microsoft Excel ® 7 th Edition Chapter 1 Defining & Collecting Data Statistics for Managers Using Microsoft Excel.

Sampling “Sampling is the process of choosing sample which is a group of people, items and objects. That are taken from population for measurement and.

Chapter 2. Surveys Survey Most widely used research method for sociologists Population Everyone with the characteristics a researcher wants to study.

Sociology Now 1 st Edition (Brief) Kimmel/Aronson *This multimedia product and its contents are protected under copyright law. The following are prohibited.

Nonresponse Rates and Nonresponse Bias In Surveys Robert M. Groves University of Michigan and Joint Program in Survey Methodology, USA Emilia Peytcheva.

Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section A 1.

Chapter 15 Sampling and Sample Size Winston Jackson and Norine Verberg Methods: Doing Social Research, 4e.

How Much Do Patients’ Preferences Contribute To Resource Use? Anthony D L, Herndon M B, et al. Health Affairs, 28, no. 3 (2009):

1 1 A two-phase life-cycle model of integrated statistical micro data Li-Chun Zhang Statistics Norway

Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc.. Chap 7-1 Chapter 7 Sampling Distributions Basic Business Statistics.

A discussion of Comparing register and survey wealth data ( F. Johansson and A. Klevmarken) & The Impact of Methodological Decisions around Imputation.

VerdierView Graph # 1 OVERVIEW Problems With State-Level Estimates in National Surveys of the Uninsured Statistically Enhancing the Current Population.

Copyright 2010, The World Bank Group. All Rights Reserved. Part 2 Survey Design Produced in Collaboration between World Bank Institute and the Development.

Guilty Smooching Wyatt Allen, Korryn Luker, Fallon Peterson.

Living arrangements, health and well-being: A European Perspective UPTAP-ONS Meeting Southampton University 19 th December 2007 Harriet Young and Emily.

Methods of Research. 1. Laboratory Experiments Research in lab setting Research in lab setting Researcher can be objective and usually provides accurate.

Cognitive test Results Mobility Question By LYDIA MOTHIBELI 6 th Annual meeting of WG Uganda Lesotho Cognitive test Lesotho Cognitive test.

Principles of exp. design Control for effects of lurking variables Randomization to keep personal biases or other preferences out of the study Replication.

Does Inclusion of Both Partial and Complete Interviews from the Source Sampling Frame Have an Effect on Nonresponse Error and Measurement Error in a National.

Measuring Violence Against Women in Australia Horst Posselt Director Family & Community Statistics Australian Bureau of Statistics UNECE Work Session on.

BHPS User Group Meeting, 2 nd May 2008 BHPS: Wave 18 Jon Burton ISER, University of Essex.

Insights and Inference Opportunities and challenges with administrative data and non-probability sources (including organic data)

Writing Frame for Critically Evaluating a Report.

INFO 4470/ILRLE 4470 Visualization Tools and Data Quality John M. Abowd and Lars Vilhuber March 16, 2011.

Neighborhood Collective Efficacy and Participation in Household Surveys Carolina Casas-Cordero PhD Candidate, JPSM University of Maryland ITSEW 2009 (Tällberg,

Will Public Health’s Response to Bioterrorism be Fair? AcademyHealth 2004 Annual Research Meeting David P. Eisenman, M.D., M.S.H.S. Assistant Professor,

Getting older while living with HIV in the United States Nokes, et al. U.S. participants (N=1293) Ages: (n=687, 53%) (n=514, 40%) 60+(n=092,

NCRM is funded by the Economic and Social Research Council 1 Interviewers, nonresponse bias and measurement error Patrick Sturgis University of Southampton.

Chapter 4: Designing Studies... Sampling. Convenience Sample Voluntary Response Sample Simple Random Sample Stratified Random Sample Cluster Sample Convenience.

Monday, June 23, 2008Slide 1 KSU Females prospective on Maternity Services in PHC Maternity Services in Primary Health Care Centers : The Females Perception.

Administrative and Web-Based Survey Data for Improving Public Policy Henry E. Brady University of California, Berkeley Henry E. Brady University of California,

Table 3. The effects of sociodemographic characteristics on patient safety Aygul Yanik et al. The Evaluation of Patient Safety in Oral and Dental Health.

Dr Grant Blank Prepared for the General Online Research conference, Cologne, Germany, 5 March 2014 Who uses Twitter? Representativeness of Twitter Users.

Gaining record linkage consent

Table 1. Sociodemographic characteristics of the employees

Nonresponse and Measurement Error in Employment Research

1 Panel 2, Position 3 Jack D. Ripper.

Inference for Sampling

Use of administrative data for statistical purposes

Presentation transcript:

Survey Perspective American Association for Public Opinion Research (AAPOR) Institute for Employment Research (IAB) Joint Program in Survey Methodology (JPSM)

Big Change in Survey Environment - Administrative data largely unused - New emerging data - Surveys are expensive and take time … BUT - Big Data / Admin data often variable poor - Linkage necessary

Challenge to Inference Responders Sample Consenters Non- Consenters Non- Responders Sample Frame/ Admin Data Linked Non-Linked

Selectivity of Consent Age, race/ethnicity, gender, education, marital status, wealth, earnings, health status, health insurance, employment Sala et al., 2014; Sala et al., 2012; Bates and Pascale, 2006; Jenkins et al., 2006; Banks et al., 2005; Dunn et al., 2003; Young et al., 2001; Woolf et al, 2000; Olson, 1999; Pullen et al., 1992 Item missing data, interviewer characteristics Sala et al., 2012 ; Jenkins et al., 2006 Wording and placement of consent request Sala et al., 2014; Sakshaug and Kreuter, 2014; Sakshaug et al., 2013

The information you have provided so far would be a lot more valuable to us if we could link it to public voting records. Do we have your permission to link your answers to your voting record?

The information you have provided so far would be a lot less valuable to us if we could link it to public voting records. Do we have your permission to link your answers to your voting record?

The information you have provided so far would be a lot less valuable to us if we could not link it to public voting records. Do we have your permission to link your answers to your voting record? 12% more “yes” answers

Other A-B tests on consent o Front 95% vs. back 86% o Variation by interviewer: 75 – 99% o Across studies in US: 24% - 85%

Question for the discussion Can we make a reasonable claim that current consent requirements are not working? - Because hard understand - Because hard to know what use in future - Because consent easily influenced by wording/framing Can we shift responsibility?

Responsible data USER

Consent Bias – 1 of many errors Total Survey Error -Successful use in ‘small data’ -Good starting point -Development needed Always in light of -Research question -Hypothesis Groves et al. 2004

13  UKDA, Essex will be next Data Access I