Neighborhood Collective Efficacy and Participation in Household Surveys Carolina Casas-Cordero PhD Candidate, JPSM University of Maryland ITSEW 2009 (Tällberg,

Slides:



Advertisements
Similar presentations
Survey Response Rates: Trends and Standards Karen Donelan, ScD Senior Scientist in Health Policy Massachusetts General Hospital/Harvard Medical School.
Advertisements

Using Paradata to Track the Incidence of Respondent Substitution and its Effect on Survey Quality Carl Ramirez, U.S. GAO FedCASIC 2009.
Survey Methodology Nonresponse EPID 626 Lecture 6.
Coverage error Survey Research and Design Spring 2006 Class #3.
Brian A. Harris-Kojetin, Ph.D. Statistical and Science Policy
A Comparison of Methods for Estimating Child Maltreatment Rates: Evaluation Approaches for a Child Maltreatment Prevention Initiative.
The estimation strategy of the National Household Survey (NHS) François Verret, Mike Bankier, Wesley Benjamin & Lisa Hayden Statistics Canada Presentation.
The English Longitudinal Study of Ageing (ELSA) Sample design & response Shaun Scholes NatCen.
Workshop Objectives 1. Components of an FBA specific to ASD Students 2. Using a Team Approach 3. How & Why complete a Motivational Scale 4. Your role in.
NLSCY – Non-response. Non-response There are various reasons why there is non-response to a survey  Some related to the survey process Timing Poor frame.
Documentation and survey quality. Introduction.
Integrating public domain data to construct community profiles Ken Reed, Betsy Blunsdon, Nicola McNeil (Deakin University, Victoria, Australia) Steven.
Family Quality of Life and Application Among People with Intellectual Disabilities and Their Families Professor Robert L. Schalock, Ph.D. Institute of.
Response rate in Switzerland Dominique Joye
Quantitative Methods in the Social Sciences (QMSS) Lugano August 2005 Increasing response rates Ineke Stoop SCP.
Agenda: Block Watch: Random Assignment, Outcomes, and indicators Issues in Impact and Random Assignment: Youth Transition Demonstration –Who is randomized?
Methodologic Overview of Two National Data Sets Centers for Disease Control and Prevention National Center for Health Statistics Issues in Comparing Findings.
Survey Perspective American Association for Public Opinion Research (AAPOR) Institute for Employment Research (IAB) Joint Program in Survey Methodology.
08/08/2015 Statistics Canada Statistique Canada Paradata Collection Research for Social Surveys at Statistics Canada François Laflamme International Total.
Who are the Nonresondents? An Analysis Based on a New Subsample of the German Socio-Economic Panel (SOEP) including Microgeographic Characteristics and.
1 Data Revolution: National Survey of Child and Adolescent Well-Being (NSCAW) John Landsverk, Ph.D. Child & Adolescent Services Research Center Children’s.
Volunteer Angler Data Collection and Methods of Inference Kristen Olson University of Nebraska-Lincoln February 2,
Sampling Techniques LEARNING OBJECTIVES : After studying this module, participants will be able to : 1. Identify and define the population to be studied.
1 General Social Survey (GSS) Cycle Content 1 st series2 nd 3 rd Health1985 (1)1991 (6) Time Use1986 (2)1992 (7)1998 (12) Victimization 1988 (3)1993.
The 2006 National Health Interview Survey (NHIS) Paradata File: Overview And Applications Beth L. Taylor 2008 NCHS Data User’s Conference August 13 th,
American Community Survey: Advocacy for Neighborhood-Level Data Florencia Gutierrez NNIP Conference May 13, 2011.
DRAFT - not for publication Nonresponse Bias Analysis in a Survey of Banks Carl Ramirez U.S. Government Accountability Office
Using Multiple Methods to Reduce Errors in Survey Estimation: The Case of US Farm Numbers Jaki McCarthy, Denise Abreu, Mark Apodaca, and Leslee Lohrenz.
Migration and Household Surveys: Sampling Design Johan A. Mistiaen The World Bank DECDG Nairobi, kenya 11 December 2006.
Chapter 8: Nonresponse Reading (read for concepts)
The National Social Climate of Tobacco Control, Robert McMillen Julie Breen Arthur G. Cosby Social Science Research Center Mississippi State.
Statistics Chapter 1: Statistics, Data and Statistical Thinking.
Poverty measurement: experience of the Republic of Moldova UNECE, Measuring poverty, 4 May 2015.
Research Design.
1 Renee M. Gindi NCHS Federal Conference on Statistical Methodology Statistical Policy Seminar December 4, 2012 Responsive Design on the National Health.
RESEARCH METHODS Lecture 20. SURVEY RESEARCH Two approaches to collect primary data 1. Observe  conditions, behavior, events, people, or processes 2.
The Challenge of Non- Response in Surveys. The Overall Response Rate The number of complete interviews divided by the number of eligible units in the.
CHAPTER 12 Descriptive, Program Evaluation, and Advanced Methods.
Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section A 1.
A Theoretical Framework for Adaptive Collection Designs Jean-François Beaumont, Statistics Canada David Haziza, Université de Montréal International Total.
A discussion of Comparing register and survey wealth data ( F. Johansson and A. Klevmarken) & The Impact of Methodological Decisions around Imputation.
Research Program and Enterprise Architecture for Adaptive Survey Design At Census Peter Miller Anup Mathur Michael Thieme May 23, 2014.
Measuring Disability: Results from the 2001 Census and the 2001 Post-Censal Disability Survey Statistics Canada January 10, 2003.
Interviewer Effects on Paradata Predictors of Nonresponse Rachael Walsh, US Census Bureau James Dahlhamer, NCHS European Survey Research Association, 2015.
11 How Much of Interviewer Variance is Really Nonresponse Error Variance? Brady T. West Michigan Program in Survey Methodology University of Michigan-Ann.
Does Inclusion of Both Partial and Complete Interviews from the Source Sampling Frame Have an Effect on Nonresponse Error and Measurement Error in a National.
Common sampling errors
The Use of Random Digit Dialing in Household Surveys: Challenges and Changes Chris Chapman 2008 IES Research Conference Washington, DC June 11, 2008
Assessing Nonresponse Bias and Measurement Error Using Statistical Matching John Dixon U.S. Bureau of Labor Statistics June 15, 2010 The opinions.
Some type of major TSE effort TSE for an “important” statistic Form a group to design a TSE evaluation for existing survey “exemplary TSE estimation plan”
© 2006 IMS Health Incorporated or its affiliates. All rights reserved. June 20, 2007 Determination of Target Sample Sizes for Physicians Surveys Darrell.
Using Data from the National Survey of Children with Special Health Care Needs Centers for Disease Control and Prevention National Center for Health Statistics.
NCRM is funded by the Economic and Social Research Council 1 Interviewers, nonresponse bias and measurement error Patrick Sturgis University of Southampton.
TAG Views on the Specification Lists From Africa and Asia Response of the Technical Advisory Group to a Request to Review Regional Product Lists.
Workshop on MDG, Bangkok, Jan.2009 MDG 3.2: Share of women in wage employment in the non-agricultural sector National and global data.
HOUSEHOLD BUDGETARY SURVEY 2008 Reno Camilleri A/Director General 10 September 2007 National Statistics Office Lascaris Valletta CMR 02 Tel: Fax:
COLLECTING DATA: SURVEYS AND ADMINISTRATIVE DATA PBAF 526 Rachel Garshick Kleit, PhD Class 8, Nov 21, 2011.
1 Survey Nonresponse Survey Research Laboratory University of Illinois at Chicago March 16, 2010.
Non-response Bias Analysis and Evaluation Reporting Passport Demand Forecasting Study 11/14/2013.
Patricia Gonzalez, OSEP June 14, The purpose of annual performance reporting is to demonstrate that IDEA funds are being used to improve or benefit.
Focus Questions What is assessment?
Interviewer Observations in the National Survey of Family Growth: Lessons Learned and Unanswered Questions Brady T. West Survey Research Center, Institute.
Nonresponse Bias in a Nationwide Dual-Mode Survey
Chapter 2: The nonresponse problem
The European Statistical Training Programme (ESTP)
Nonresponse and Measurement Error in Employment Research
The European Statistical Training Programme (ESTP)
Qualtrics for data collection
Chapter 2: The nonresponse problem
Chapter 5: The analysis of nonresponse
Presentation transcript:

Neighborhood Collective Efficacy and Participation in Household Surveys Carolina Casas-Cordero PhD Candidate, JPSM University of Maryland ITSEW 2009 (Tällberg, Sweden)

1. Motivation Increased focus on Nonrespose Bias Interest on “potential” of Paradata – Observational data collected by interviewers is a special case – Focus of my research: Neighborhood characteristics Already existing frameworks linking – Neighborhood Characteristics and Survey Participation (P) (Groves and Couper 1998; Johnson et al 2006) – Neighborhood Characteristics and Individual Outcomes (Y) (Sampson et al 2002; Kawachi and Berkman 2003) 2

Conceptual Framework of Survey Participation Social Environment Survey Design Household(er) Interviewer Decision to Participate Groves and Couper (1998) 3

2. Research Papers Paper 1: Neighborhood Collective Efficacy and Participation in Household Surveys (Data: LA FANS) Paper 2: Quality of Observational Data Collected by Survey Interviewers (Data: LA FANS) Paper 3: Impact of Different Types of Auxiliary Data on Estimates of Nonresponse Bias (Data: NRB) 4

3. Datasets Los Angeles Family and Neighborhood Study (LA FANS) – ~2600 interviews (parents + children) – 65 census tracts, 422 census blocks, 2029 blockfaces – 2+ interviewer ratings of neighborhood characteristics (per blockface) – 64 neighborhood items (physical disorder, social disorder, physical decay, security measures, land use, presence of institutions, etc) Nielsen Nonresponse Bias Study (NRB) – Follow up study of respondents and nonrespondents (n=9,000) – Multiple sources of auxiliary data for different sets of cases: Frame, Claritas (~Census data), Call Record, Interviewer Observations, Follow Up Survey, Original Diary Survey 5

4. Planned Analysis 6

Analysis Paper 1 - Neighborhood Collective Efficacy and Participation in HH Surveys 1.Estimate Survey Response Models (SRM) using predictors at different levels – Neighborhood level, Household level, Person level 2.Estimate SRM using different indicators of Neighborhood Collective Efficacy – Respondent Reports, Interviewer Observations, Census Data 3.Estimate SRM for different disposition outcomes – Ineligible HU, Unable to Contact, Unable to Communicate, Refused, Screened, Rostered, Interviewed 7

Analysis Paper 2 - Quality of Observational Data Collected by Survey Interviewers 1.Descriptive Stats – % missing data, same response pattern, kappa 2. Multilevel Cross-Classified Models – Structure: Tracts > Interviewers X Blockfaces > Items – Random effects: Tract, Interviewers, Blockfaces – Fixed effects: Interviewers, Blockfaces, Items 3.Item Response Model 4.Meta Analysis across 64 Items 8

Analysis Paper 3 - Impact of Different Types of Auxiliary Data on Estimates of NR Bias 1.Potential for NR Bias Analysis – Corr(NOBS, P) – Corr(NOBS, Y) 2.Comparison of estimates of NR Bias using different types of auxiliary data – Apply “typical” estimation methods for each type of data (frame, follow up, census, etc) – Standardize estimates – Compare relative size effects 9

This is work in progress … Feedback is really welcomed! 10