Workshop B7: Surveying ‘Hard to Reach’ Groups 13 participants –Austria:1 –Denmark:1 –France:3 –South Africa:1 –Switzerland:1 –United Kingdom:1 –Unites.

Slides:



Advertisements
Similar presentations
Survey Response Rates: Trends and Standards Karen Donelan, ScD Senior Scientist in Health Policy Massachusetts General Hospital/Harvard Medical School.
Advertisements

Survey Methodology Nonresponse EPID 626 Lecture 6.
Self-Administered Surveys: Mail Survey Methods ChihChien Chen Lauren Teffeau Week 10.
© 2014 by the Regents of the University of Michigan Social Survey Data Collection Challenges and Trends Gina Cheung Beth-Ellen Pennell North American DDI.
EKOS Research Associates Inc. Interactive Voice Response: The Past, the Present, and Into the Future Presentation to: The MRIA Ottawa Chapter January 21,
Overview: Online Surveys Vasja Vehovar University of Ljubljana, Slovenia Handbook of Online Research Methods Colloquium March 2007.
Surveys 調查研究 中央大學. 資訊管理系 范錚強 mailto:
Data Collection Methods
Survey-Data Collection Methods. Ch 92 Surveys A survey involves interviews with a large number of respondents using a predesigned questionnaire. Four.
Objectives of Session Seven Complete in-class survey Discuss question formats and ordering Case study: face-to-face interviews v. self-administered questionnaires.
Sampling Adolescents/Young Key Populations (A/YKP) at Risk of HIV Exposure Using Respondent Driven Sampling (RDS) LISA G. JOHNSTON
United Nations Workshop on Revision 3 of Principles and recommendations for Population and Housing Censuses and Census Evaluation Amman, Jordan, 19 – 23.
Measuing Preferences, Establishing Values, The Empirical Basis for Understanding Behavior David Levinson.
McGraw-Hill/Irwin Business Research Methods, 10eCopyright © 2008 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 9 Surveys.
Questionnaire Designing Developing the best instrument to collect data for your research.
Learning Objective Chapter 7 Primary Data Collection: Survey Research CHAPTER seven Primary Data Collection: Survey Research Copyright © 2000 by John Wiley.
Chapter 10 Surveys McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All Rights Reserved.
United Nations Workshop on Revision 3 of Principles and recommendations for Population and Housing Censuses and Census Evaluation Amman, Jordan, 19 – 23.
Survey Research and Other Ways of Asking Questions
McGraw-Hill/Irwin Business Research Methods, 10eCopyright © 2008 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 9 Surveys.
The Data we Collect (and how we collect them) Arie Kapteyn.
Workshop B4. The Collection and Processing of Survey Data Using Mobile Technologies.
Adding a Mode as a Final Step in the Follow-up of a Panel Survey Seminar on New Frontiers for Statistical Data Collection Geneva, Switzerland, 31 October.
KY Module 2 Household Travel Surveys Chapter 6 of TS Manual.
Stat-472 Survey design Questionnaire Design Issues Nonresponse, Refusals and Response Rate.
Chapter Seven Copyright © 2006 McGraw-Hill/Irwin Descriptive Research Designs: Survey Methods and Errors.
2020 Census: Program Overview, Testing, and Technological Innovations
Lesli Scott Ashley Bowers Sue Ellen Hansen Robin Tepper Jacob Survey Research Center, University of Michigan Third International Conference on Establishment.
Data Collection Method
Migration and Household Surveys: Sampling Design Johan A. Mistiaen The World Bank DECDG Nairobi, kenya 11 December 2006.
McGraw-Hill/Irwin Business Research Methods, 10eCopyright © 2008 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 9 Surveys.
McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10.
1 1 Web in mix-mode surveys in Norway Bengt Oscar Lagerstrøm Symposium on General Population Surveys on the web, London November 2011.
Testing of Pre-registration in Preparation for the 2020 US Census UNECE/Eurostat Group of Experts on Population and Housing Censuses September 23, 2014.
Copyright 2000 Prentice Hall5-1 Chapter 5 Marketing Information and Research: Analyzing the Business Environment.
The Challenge of Non- Response in Surveys. The Overall Response Rate The number of complete interviews divided by the number of eligible units in the.
Joint OECD / European Commission workshop on international development in business and consumer tendency surveys Nov Task force on improvement.
Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section B 1.
1 Non-Response Non-response is the failure to obtain survey measures on a sample unit Non-response increases the potential for non-response bias. It occurs.
Measurement of Income in NCHS Surveys Diane M. Makuc NCHS Data Users Conference July 12, 2006 Centers for Disease Control and Prevention National Center.
Chapter Eleven The entire group of people about whom information is needed; also called the universe or population of interest. The process of obtaining.
McGraw-Hill/Irwin Copyright 2006 The McGraw-Hill Companies, Inc. All rights reserved Chapter 11 Surveys and Interviews.
Richard E. Bilsborrow Consultant, MEDHIMS and World Bank University of North Carolina at Chapel Hill Presented at ECE Work Session.
McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10.
1 Web interviewing at Statistics Netherlands: practices so far Labour Force Survey The Netherlands Björn Janssen Hendrika Lautenbach April 2010.
Survey Research Chapter Seven. Chapter Seven Objectives Understand the reasons for the popularity of survey research Learn about types of surveys Understand.
Unit 2: Collecting Data & Survey Design The work of statisticians is highly valued as they provide everything needed by those coming from different background.
Descriptive Research & Questionnaire Design. Descriptive Research Survey versus Observation  Survey Primary data collection method based on communication.
2 Transatlantic Trends: Immigration TTI is a public opinion survey conducted using randomized telephone interviews In each country around 1,000 people.
1 Chapter 13 Collecting the Data: Field Procedures and Nonsampling Error © 2005 Thomson/South-Western.
The Measurement of Remittances Using Surveys in Industrialized Countries Mathias Lerch, Philippe Wanner and Werner Haug Laboratoire de démographie, University.
Workshop on Passenger Mobility Conclusions. EU data requirements – DG MOVE  Environmental, economic and social considerations require close monitoring.
Agenda: Surveys –In-person, Paper, telephone, and web –Computer assisted –Instrument Design Administrative data WorkFirst Longitudinal Study Hands-on surveys.
The WageIndicator Web- survey and the online and offline population. Kea Tijdens; Workshop 7, 17:00 – 18:00.
McGraw-Hill/Irwin Business Research Methods, 10eCopyright © 2008 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 9 Surveys.
2007 Household Travel Survey
Evaluating Survey Data Collection Methods

Chapter 2: The nonresponse problem
Multi-Mode Data Collection Approach
The European Statistical Training Programme (ESTP)
13th Workshop on Labour Force Survey Methodology
Chapter 7: Reducing nonresponse
The European Statistical Training Programme (ESTP)
Chapter 14: Mixed-mode datacollection
The change of data sources in the Spanish SILC
Multi-Mode Data Collection Approach
The European Statistical Training Programme (ESTP)
Multi-Mode Data Collection
Chapter 2: The nonresponse problem
Presentation transcript:

Workshop B7: Surveying ‘Hard to Reach’ Groups 13 participants –Austria:1 –Denmark:1 –France:3 –South Africa:1 –Switzerland:1 –United Kingdom:1 –Unites States:5 Resource paper: Riandey and Quaglia (Surveying hard to reach groups) Contributed paper: Contrino et al (A reexamination of methods in the US National Household Travel Surveys) Contributed paper: Cowham et al (Prioritising street improvements for respondents with disabilities: qualitative and quantitative research)

Questions discussed 1.Who are ‘hard to reach’ groups in travel surveys, and how does this differ by type of survey (e.g. telephonic vs. mail-back vs. home interview, etc.) and by context? 2.What bias is introduced by lack of coverage of ‘hard-to-reach’ groups? E.g. how does their absence/under-representation affect our estimates and forecasts of travel, or public policies? 3.Looking forward, how do we foresee this problem—getting less, getting worse? Why? 4.What measures can be taken to ensure that ‘hard to reach’ groups are included adequately in sample frames and selections? 5.What measures can be taken to ensure that selected ‘hard to reach’ respondents are successfully recruited and surveyed? 6.What forms of survey instruments are appropriate to reach ‘hard to reach’ groups, and how should these instruments be developed and tested? 7.If we could completely re-design survey practice, what kinds of things would we include to integrate respondents from hard-to-reach groups into the survey?

1. Who are ‘hard to reach’ groups in travel surveys, and how does this differ by type of survey (e.g. telephonic vs. mail-back vs. home interview, etc.) and by context? Persistent non-responders: Foreign language Illiterates Disengaged High/low income Adolescents Fearful ‘Gate-kept’ individuals Physically disabled Mentally disabled Non-coverage in sample frames: Illegal immigrants Transients Squatters Homeless Sub-letters Group quarters Inaccessible workers

2. What bias is introduced by lack of coverage of ‘hard-to-reach’ groups? E.g. how does their absence/under-representation affect our estimates and forecasts of travel, or public policies? Bias depends on: –Survey method (e.g. CATI vs. PAPI vs. CASI vs. CAWI) –Context Significance varies by survey purpose –Aggregate travel patterns –Special group surveys Research gap: size of HTR groups

3. Looking forward, how do we foresee this problem— getting less, getting worse? Why? Drivers of change: –Technology –Migration –Demography –Economy –Legal barriers/benefits

4. What measures can be taken to ensure that ‘hard to reach’ groups are included adequately in sample frames and selections? Multi-frame sampling –Land line phone –Mobile phone –Address frame –Association/organization membership lists –Etc. Identification and recruiting –General population surveys – frame completeness –Specific population surveys – cost of screening to identify individuals, or access panels

5. What measures can be taken to ensure that selected ‘hard to reach’ respondents are successfully recruited and surveyed? Toolkit of recruitment techniques –Advertisements –Association registers/lists –Advance letters –Endorsements –Incentives/gifts –Language specialists

6. What forms of survey instruments are appropriate to reach ‘hard to reach’ groups, and how should these instruments be developed and tested? Multi-modal with special components tailored for HTRGs –But are results compatible with main survey? Non-response follow up surveys of two types –Short last-ditch version to get essential travel-related information – Short questionnaire for demographics/reasons for non-response –Mode depends on HTRG –Don’t wait until end Design of instrument depends on purpose

7. If we could completely re-design survey practice, what kinds of things would we include to integrate respondents from hard-to-reach groups into the survey? Ideal device to encourage HTRGs to participate –Inexpensive –Attractive/useful as a give-away after data collection finished –Customizable for HTG group –Non-intrusive –Secure –Passive fully automated data collection –Multiple sensing capabilities – not just GPS –Close to real time data transmission w/feedback

Quantitative survey: visual material (Cowham et al) STREET FURNITURE & BENCHES: EXAMPLE CHOICE CARD