Self-Administered Surveys: Mail Survey Methods ChihChien Chen Lauren Teffeau Week 10.

Slides:



Advertisements
Similar presentations
Census and Statistics Department Introduction to Sample Surveys.
Advertisements

SURVEY RESEARCH: BASIC METHODS OF COMMUNICATION WITH RESPONDENTS
 1. Defining research objectives  2. Selecting a sample  3. Designing the questionnaire format  4. Pretesting the questionnaire  5. Pre-contacting.
Survey Methodology Nonresponse EPID 626 Lecture 6.
STATISTICS FOR MANAGERS LECTURE 2: SURVEY DESIGN.
5.00 Understand Promotion Research  Distinguish between basic and applied research (i.e., generation of knowledge vs. solving a specific.
1 Health Surveys January 2008 Diane Martin, MA, PhD.
4.11 PowerPoint Emily Smith.
The Purpose of Statement
© 2003 Prentice-Hall, Inc.Chap 1-1 Business Statistics: A First Course (3 rd Edition) Chapter 1 Introduction and Data Collection.
SE 450 Software Processes & Product Metrics Survey Use & Design.
© 2002 Prentice-Hall, Inc.Chap 1-1 Statistics for Managers using Microsoft Excel 3 rd Edition Chapter 1 Introduction and Data Collection.
Business research methods: data sources
Principles of Marketing
Survey Methods: Communicating with Respondents
Basic Business Statistics (8th Edition)
Chapter 13 Survey Designs
FINAL REPORT: OUTLINE & OVERVIEW OF SURVEY ERRORS
Chapter 9 Descriptive Research. Overview of Descriptive Research Focused towards the present –Gathering information and describing the current situation.
1 © 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation ONLINE SURVEYS.
How to Assess Student Learning in Arts Partnerships Part II: Survey Research Revised April 2, 2012 Mary Campbell-Zopf, Ohio Arts Council
EMR 6500: Survey Research Dr. Chris L. S. Coryn Kristin A. Hobson Spring 2013.
Descriptive and Causal Research Designs
Survey Methods By Shivakumaraswamy, K N
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 13 Survey Designs.
Survey Research and Other Ways of Asking Questions
Questionnaires and Interviews
Agenda for Define Key Terms Read & Take Notes The Persuaders
By: Christopher Prewitt & Deirdre Huston.  When doing any project it is important to know as much information about the project and the views of everyone.
Making Sense of the Social World 4th Edition
Chapter 12: Survey Designs
Descriptive and Causal Research Designs Copyright © 2010 by the McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
Lesli Scott Ashley Bowers Sue Ellen Hansen Robin Tepper Jacob Survey Research Center, University of Michigan Third International Conference on Establishment.
Chapter 29 conducting marketing research Section 29.1
Effectiveness of Monetary Incentives and Other Stimuli Across Establishment Survey Populations ICES III 2007 Montreal, Quebec Canada Danna Moore.
Marketing Research Process Chapter 29. What factors influence restaurants to add low fat menu items? How can they determine success of items? Journal.
Scot Exec Course Nov/Dec 04 Survey design overview Gillian Raab Professor of Applied Statistics Napier University.
Collecting Information via the Web Stephen Porter Director of Institutional Research Michael Roy Director of Academic Computing Services.
Chapter 12 Sample Surveys
Brown, Suter, and Churchill Basic Marketing Research (8 th Edition) © 2014 CENGAGE Learning Basic Marketing Research Customer Insights and Managerial Action.
Copyright © 2008 by Nelson, a division of Thomson Canada Limited Chapter 8 Part 2 Designing Research Studies SURVEY RESEARCH: BASIC METHODS OF COMMUNICATION.
The Challenge of Non- Response in Surveys. The Overall Response Rate The number of complete interviews divided by the number of eligible units in the.
Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section A 1.
Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section B 1.
AP STATISTICS Section 5.1 Designing Samples. Objective: To be able to identify and use different sampling techniques. Observational Study: individuals.
Survey Research Chapter 7. The Nature of Surveys  Definition  Advantages  Disadvantages –Errors.
6: Descriptive and Causal Research Designs. 6-2 Copyright © 2008 by the McGraw-Hill Companies, Inc. All rights reserved. Hair/Wolfinbarger/Ortinau/Bush,
Chapter Five Survey Designs Survey Design Cross-sectional studies that collect data on a topic at 1 point in time Measures many variables at once Uses.
Survey Research. In Case of a System Glitch… After forming into your usual teams: –Create a brief survey that seeks to discern citizens’ attitudes about.
Questionnaires Questions can be closed or open Closed questions are easier to analyze, and may be done by computer Can be administered to large populations.
The effects of Peer Pressure, Living Standards and Gender on Underage Drinking Psychologist- Kanari zukoshi.
Basic Business Statistics, 8e © 2002 Prentice-Hall, Inc. Chap 1-1 Inferential Statistics for Forecasting Dr. Ghada Abo-zaid Inferential Statistics for.
1 Chapter 13 Collecting the Data: Field Procedures and Nonsampling Error © 2005 Thomson/South-Western.
Copyright © 2008 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved. John W. Creswell Educational Research: Planning,
Quantitative research Meeting 7. Research method is the most concrete and specific part of the proposal.
Sampling & Simulation Chapter – Common Sampling Techniques  For researchers to make valid inferences about population characteristics, samples.
Numeracy & Quantitative Methods Laura Lake. Postal surveys or questionnaires are a form of self- completion or self-administered questionnaire. Self-completion:
THE MARKETING RESEARCH PROCESS CHAPTER 29 Mrs. Simone Seaton Marketing Management.
Introduction/ Section 5.1 Designing Samples.  We know how to describe data in various ways ◦ Visually, Numerically, etc  Now, we’ll focus on producing.
Section 29.1 Marketing Research Chapter 29 conducting marketing research Section 29.2 The Marketing Survey.
Using Surveys to Design and Evaluate Watershed Education and Outreach Day 5 Methodologies for Implementing Mailed Surveys Alternatives to Mailed Surveys.
McGraw-Hill/Irwin © 2003 The McGraw-Hill Companies, Inc.,All Rights Reserved. Part Three SOURCES AND COLLECTION OF DATA.
RESEARCH METHODS Lecture 22
Chapter 7: Client Satisfaction
Descriptive and Causal Research Designs
Health Survey Research
Part Three SOURCES AND COLLECTION OF DATA
Survey Design & Use.
RESEARCH METHODS Lecture 21
What do Samples Tell Us Variability and Bias.
Presentation transcript:

Self-Administered Surveys: Mail Survey Methods ChihChien Chen Lauren Teffeau Week 10

Dillman, 1991 Why MAIL surveys? Lower costs Perception of simple procedures Large scale general public Time People with hearing problem

Dillman Cont’d Sampling Error Noncoverage Error – incomplete sampling frame Nonresponse Error – people don’t answer Measurement Error – instrument deficiencies Sources of Survey Error:

Reducing Nonresponse Error Why is increasing response rate important in mail survey design? Hard to make the comparison between respondents and nonrespondents. What and How do they differ?

Dillman Cont’d Reducing Nonresponse Error…  Response Rate is indicator How to improve Response Rates? Subjective assessments: follow-up mailings, prior notice, incentives, return postage, sponsorship, personalization, interest in survey topic Quantitative assessments via meta-analysis: number of contacts (initial and follow-up); salience of topic; government sponsorship; employee, school or army population; incentive on first contact – Negative effects: market research, sponsorship, general population & length

Understanding Mail Survey Response Behavior: A Meta-Analysis (Yammarino, Skinner & Childers, 1991) To enhance understanding of mail survey response behavior by presenting a more comprehensive meta-analysis investigation of factors that affect mail survey response rates.

Yammarino et. al. Cont’d Feature 2: combined meta-analysis procedures Features 3: more factors through a larger number of study outcomes Features 4: investigation of two moderator variables Feature 1: incorporate several aspects of a properly conducted meta-analysis

Yammarino et. al. Cont’d Key results –a cover letter that includes appeals and a survey of less than four pages works for all target population –a reply/return envelop and monetary incentives are situation specific and need to consider other moderators –a preliminary notification subject to time period. In the study: ’76-87 –a stamped/metered return postage varied with time. In the study: ’40-70 differed for samples of groups –a follow-ups/repeated contacts differed from samples of groups) –Examine more moderators in subgroup characteristics of respondents, additional details about samples, way of survey delivered and situation (time & location) in which surveys are administered/completed

Dillman Cont’d Total Design Method – What is it? Recommended procedures that should be used holistically versus a la carte Based on Social Exchange theory Results in high response rates What are some limitations? Lack of empirical evidence Ignores the effect of financial incentives Over-reliance on social exchange? No tailorization for different populations

Dillman Cont’d Updating Total Design Method: Only a perspective on how to stimulate responses, not definitive… Need for updating; hence, ‘Tailored’ Design Method, 2000 Tailored b/c computers make it easier to customize surveys to specific populations Attempts to create respondent trust, perceptions of increased rewards, and reduced social costs to respondents Increased emphasis on visual design

Dillman Cont’d How to reduce Measurement Error? In mail surveys, measurement error usually stems from: Item non-response Poor open-ended responses Low education of respondents Complex skip patterns Question order Importance of pre-testing Fostering response conditions: cover letter, follow-ups, incentives etc. Know your population Limit skips and craft clear questions (wording and visual placement on survey)

Dillman Cont’d Less chance of interviewer subversion Less social desirability pressure How do Mail surveys impact respondents’ answers? What special considerations must researchers make for Mail surveys? Slower and potentially more costly data collection Cannot forget self-administered environment: - Clarity of questions and instructions paramount to lessen measurement error - Issue of who is answering survey (may not be intended respondent; salience of topic may influence returns)

Dillman Cont’d –Self-administered lessens order effects –Mail respondents less extreme answers –Mail respondents less social desirability –Pacing of mail surveys – more cognition time vs off-the-top-of-the-head answers What are some advantages of Mail over Telephone surveys? What about Context effects? Respondents don’t have to answer surveys linearly (Schwarz & Hippler – norm of evenhandedness) If in doubt, use split-ballot to control for potential effects. Use priming to your advantage if possible

Dillman Cont’d How to reduce Noncoverage Error? –Important especially with mail because of reliance on household addresses, which are usually out-of-date –Area of further research and development of practices Have accurate sampling frame. What if you don’t? Find a different way to do your research OR create your sampling frame = much more cost and more lead time.

Maximizing Response Rates You get a national grant to administer a mail survey. What steps would you follow to get the highest response rate possible if expense was not an issue? You find out that you will only get a fraction of the funding you need to administer a survey for your dissertation. What steps would you follow to get the highest response rate relative to your budget?

Web Surveys are Self-Administered Too! What is similar between web and mail surveying techniques? What what do you need to account for if doing a web instead of mail survey? What are the advantages of mixed methods?