Designing Questionnaires Chapter 15. Selecting Question Type Open ended questions: no response options provided. Open ended questions: no response options.

Slides:



Advertisements
Similar presentations
This ad from Greenfield Online suggests that well-executed research can save a company from making a costly mistake on new product introductions.
Advertisements

Developing a Questionnaire
What is a Survey? A scientific social research method that involves
Survey Methodology Survey Instruments (2) EPID 626 Lecture 8.
Using Surveys for Assessment Best Practices in Assessment February 9, 2012.
King Fahd University of Petroleum & Minerals Department of Management and Marketing MKT 345 Marketing Research Dr. Alhassan G. Abdul-Muhmin Questionnaire.
Coordinator, UWS SoTL Leadership Site
RESEARCH MEASUREMENT AND QUESTIONNAIRE DESIGN
Questionnaire & Form Design
Designing and Analyzing Questionnaires
Designing Effective Surveys. Conceptualizing Your Research Conceptualize your primary research; Figure out what you need to know If you need information.
Bangor Transfer Abroad Programme Marketing Research Questionnaire Design (re. Zikmund Chapter 11)
Survey Design & Item Construction Lindsay Couzens, M.S. UNLV’s 2009 Academic Assessment Workshop May 14 th & 15 th.
1 Sources:  SusanTurner - Napier University  C. Robson, Real World Research, Blackwell, 1993  Steve Collesano: Director, Corporate Research and Development.
Questionnaire Design.
Research & Consumer Behavior H Edu Activity On The Draw On The Draw “Drawing” the Customer “Drawing” the Customer.
Chapter11 Designing Data Collection Forms. The Functions of a Questionnaire Translates the research objectives into specific questions Standardizes questions.
Determining the Order of Questions
Designing the Questionnaire. Logical Steps to Develop a Good Questionnaire Recall the research objective, the research questions and hypotheses Identify.
DR. DAWNE MARTIN MKTG 241 FEB. 15, 2011 Marketing Research.
9: Designing the Questionnaire. 9-2 Copyright © 2008 by the McGraw-Hill Companies, Inc. All rights reserved. Hair/Wolfinbarger/Ortinau/Bush, Essentials.
CHAPTER eleven Questionnaire Design Copyright © 2002
COM Taejin Jung, Ph.D. Week 11: Survey and Poll Methods.
Survey Research and Other Ways of Asking Questions
The Marketing Survey How to construct a survey
Questionnaire Design Chapter Nine. Chapter Nine Objectives To understand the role of the questionnaire in the data collection process. To become familiar.
1 Chapter 11: Survey Research Summary page 343 Asking Questions Obtaining Answers Multi-item Scales Response Biases Questionnaire Design Questionnaire.
CHAPTER 15 Questionnaires. What is a questionnaire? A questionnaire is a means of gathering survey data from a large number of people A questionnaire.
Type author names here Social Research Methods Chapter 10: Self-completion questionnaires Alan Bryman Slides authored by Tom Owens.
Designing Data Collection Forms
Data Collection Methods
Chapter Seven: Questionnaire Design
SOME QUESTIONS???? PAPIA BAWA Class Exercise. Question Set 1 Suppose we are trying to gather statistics regarding the efficacy of the death penalty. Here.
COMMUNICATION ARTS RESEARCH A. PARICHART W. AND A. CHULAMANI C.
5.4 Creating Survey Questions. Surveys Very common for data collection Types: –Face-to-face interviews –Telephone surveys –Internet surveys –Mail-in surveys.
 Open ended questions: no options provided. ◦ Pros:  access ideas the researcher has not considered  insight into respondents’ vocabulary  insight.
Questionnaire Design. Questionnaires Inexpensive – postage and photocopies Potential of large # of respondents Easy to administer confidentially – embarrassing.
Questionnaire Construction Assessment Team November 6, 2007 PowerPoint by JD White and Joel H. Scott.
MARKETING SURVEYS Constructing the Questionnaire validity  A questionnaire has validity when the questions asked measure what they were intended.
Chapter 12 Survey Research.
Question Wording Pierre-Auguste Renoir: The Ball at the Moulin de la Galette (1876)
CHAPTER 11 – QUESTIONNAIRE DESIGN Zikmund & Babin Essentials of Marketing Research – 5 th Edition © 2013 Cengage Learning. All Rights Reserved. May not.
Chapter Ten The Role of the Questionnaire Key Terms & Definitions A Questionnaire: Set of questions designed to generate the data necessary to accomplish.
Measurement and Questionnaire Design. Operationalizing From concepts to constructs to variables to measurable variables A measurable variable has been.
Questionnaire Design. What is a Questionnaire? A set of Questions designed to generate the information needed to accomplish the research objectives.
Self-completion Questionnaires
Questionnaire Design.  Ensures standardization and comparability of the data across interviews  Increases speed and accuracy of recording  Facilitates.
10 Questionnaire Design. Role of Questionnaire Survey research, by definition, relies on the use of a questionnaire. A questionnaire is a set of questions.
Designing a Questionnaire. Major Function of a Questionnaire –Translating the research objectives into specific questions Iterative Process –A good.
Chapter X Questionnaire and Form Design. Chapter Outline Chapter Outline 1) Overview 2) Questionnaire & Observation Forms i. Questionnaire Definition.
Chapter Eight Questionnaire Design Chapter Eight.
Creating A Good Questionnaire IB Geography. Advantages and Disadvantages of Questionnaires Advantages –Can assess a large group quickly –Easy to analyze.
Descriptive Research & Questionnaire Design. Descriptive Research Survey versus Observation  Survey Primary data collection method based on communication.
Items & Scales. Overarching Theme: Write Understandable Items that Can Be Answered Easily.
PREPARATION OF QUESTIONNAIRES PREPARATION OF QUESTIONNAIRES Chapter - 4 Dr. BALAMURUGAN MUTHURAMAN
Essentials of Marketing Research Kumar, Aaker, Day Chapter Ten Designing the Questionnaire.
Questionnaire Design & Issues Lecture & Seminar. J.D. Power Asks: It’s Interesting, But Do You Really Want It? 15-2 Car makers have to evaluate what features.
SurveyMonkey The Quest For Meaning In A World Gone Mad Created by Elizabeth Maloney, CCA District C Director Michael Smith, CCA Communication Director.
Journal Entry §Do you think taking surveys online has had a positive or negative effect of marketing research? Why?
Questionnaires. I. Constructing a questionnaire 1. Tick items in lists or boxes 2. In addition other types are often used: a straight choice between two.
Questionnaire Design. What is a Questionnaire? A set of Questions designed to generate the statistical information from a specific demographic needed.
BY :SALEEQ AHMAD ROLL NO: 06
Designing Questionnaire
Creating Survey and Interview Questions
The Marketing Survey By: Master Ence.
Structured Interviews and Instrument Design Part I
Marketing Surveys Lecture: min 29.2.
Effective questionnaire be designed as a holistic tool; the overall picture should be clear begin with a brief introduction providing clear and simple.
Questionnaire Design (re. Zikmund Chapter 11).
Presentation transcript:

Designing Questionnaires Chapter 15

Selecting Question Type Open ended questions: no response options provided. Open ended questions: no response options provided. Pros: access concepts the researcher has not considered, gain insight into respondents’ vocabulary regarding the topic, gain insight into relative importance (based on ordering) Pros: access concepts the researcher has not considered, gain insight into respondents’ vocabulary regarding the topic, gain insight into relative importance (based on ordering) Cons: difficult to record, to code, to enter data resulting in greater expense and time Cons: difficult to record, to code, to enter data resulting in greater expense and time Closed ended questions (fixed alternative): responses are provided. Closed ended questions (fixed alternative): responses are provided. Pros: cheaper, faster, easier data collection and entry Pros: cheaper, faster, easier data collection and entry Cons: miss “rich” data, only measures what researcher has conceived. Cons: miss “rich” data, only measures what researcher has conceived.

Fixed Alternative Questions Dichotomous: choose one of two, e.g. yes/no Dichotomous: choose one of two, e.g. yes/no Multiple choice alternatives: Multiple choice alternatives: determinant choice: select only one determinant choice: select only one frequency determination: assesses general frequency, select one frequency determination: assesses general frequency, select one checklist: select all that apply checklist: select all that apply Scale responses Scale responses Likert, Semantic differential, sum scales, distance, etc. Likert, Semantic differential, sum scales, distance, etc.

Question “Shoulds” Single issue per question Single issue per question Brief Brief Common interpretation Common interpretation Comprehensible vocabulary Comprehensible vocabulary Simple Simple Exhaustive categories Exhaustive categories Mutually exclusive categories Mutually exclusive categories

Question “Should nots” No unclear assumptions No unclear assumptions Why do you download music? (You may check off more than one box.) Why do you download music? (You may check off more than one box.) ____ CDs are too expensive. ____ CDs only contain a few good songs. ____ It is more practical (no need to leave home). ____ Rather spend money elsewhere. ____ Do not believe in supporting the music industry. ____ Convenience. ____ Other. This assumes that they download. This assumes that they download. Not beyond experience/ability Not beyond experience/ability Who was the best U of L president in the last 3 decades? Who was the best U of L president in the last 3 decades?

Question “Should nots” No specific examples (unless needed) No specific examples (unless needed) What is your favourite brand of chocolate bar? (e.g. Coffee Crisp, Snickers, etc.) __________________ What is your favourite brand of chocolate bar? (e.g. Coffee Crisp, Snickers, etc.) __________________ Stating a few limits ability to remember others (part-list cueing effect) Stating a few limits ability to remember others (part-list cueing effect) Don’t ask info they can’t remember Don’t ask info they can’t remember How much did you spend on groceries in the last month? ____________ How much did you spend on groceries in the last month? ____________ No ambiguity No ambiguity How many advertisements promoting music sharing can you recall? A)0 How many advertisements promoting music sharing can you recall? A)0 B)1-2 B)1-2 C)3-4 C)3-4 D) more than 4 D) more than 4 Does this mean different ads, or different showings of an ad? Does this mean different ads, or different showings of an ad?

Question “Should nots” No double-barreled questions No double-barreled questions I believe that all that is legal is ethical and all that is illegal is unethical. I believe that all that is legal is ethical and all that is illegal is unethical. Strongly disagree Strongly agree What if they believe all that is illegal is unethical, but all that is legal isn’t necessarily ethical? No leading questions No leading questions Do you support the school board’s innovative new math curriculum? Do you support the school board’s innovative new math curriculum? Not at all Strongly support “innovative, new” suggests what the “correct” answer is

Question “Should nots” No loaded questions No loaded questions Do you support helping child victims of AIDS? Do you support helping child victims of AIDS? Not at all Strongly support The “morally correct” answer is obvious Not overly complex Not overly complex Do you feel that the contractual clause 59B section II should be revised to indicate the new funding options available to employees in the temporary worker category when workers are eligible for maternity/paternity leave, conditional upon their years of service and job classification? Do you feel that the contractual clause 59B section II should be revised to indicate the new funding options available to employees in the temporary worker category when workers are eligible for maternity/paternity leave, conditional upon their years of service and job classification? Yes__No__ Yes__No__

Dillman's "Total Design Method“ for Survey Research (mail surveys) Use attractive single unit (e.g. one nice survey booklet) Use attractive single unit (e.g. one nice survey booklet) Offer incentives (don’t have to be large) Offer incentives (don’t have to be large) Use postcard to warn Use postcard to warn Use postcard to remind Use postcard to remind

Questionnaire Order “Cover letter” “Cover letter” Who, purpose, explanation, incentive, screening (as needed) Who, purpose, explanation, incentive, screening (as needed) Instructions Instructions How to proceed (e.g. don’t skip ahead/back) How to proceed (e.g. don’t skip ahead/back) Screening Screening Get the right people Get the right people Warm-up (if necessary) Warm-up (if necessary) Easy questions Easy questions Interesting questions Interesting questions Transition statement (if necessary) Transition statement (if necessary) Key content/difficult questions Key content/difficult questions Demographics Demographics

Sequencing Gain attention, pique interest Gain attention, pique interest Start easy and interesting Start easy and interesting Avoid priming concepts, directing responses Avoid priming concepts, directing responses General to specific; Open to closed General to specific; Open to closed Randomize or counterbalance Randomize or counterbalance Response order; Question order Response order; Question order Place similar questions together Place similar questions together mind frame mind frame Clearly distinguish question and responses Clearly distinguish question and responses CAPS versus lower case, etc. CAPS versus lower case, etc.

Clearly distinguish question from responses: LAYOUT A (bad): Do you agree, disagree or have no opinion that this company has: A good vacation policy - disagree/not sure/agree. A good vacation policy - disagree/not sure/agree. Good management feedback - disagree/not sure/agree. Good management feedback - disagree/not sure/agree. Good medical insurance - disagree/not sure/agree. Good medical insurance - disagree/not sure/agree. LAYOUT B (better): Does this company have: Disagree Not Sure Agree Disagree Not Sure Agree A good vacation policy A good vacation policy Good feedback Good feedback Good medical insurance Good medical insurance 1 2 3

Pretesting Pretest the questionnaire Pretest the questionnaire Test on “experts” Test on “experts” Test on target market Test on target market Pretesting approaches Pretesting approaches Complete the survey Complete the survey Interpret the questions: what do they “mean” Interpret the questions: what do they “mean” Define key words Define key words Comment on confusing items, missing items Comment on confusing items, missing items Address response options as well as questions Address response options as well as questions

Response Issues Halo effect Halo effect Positivity/negativity bias Positivity/negativity bias Extremeness aversion/extremeness seeking Extremeness aversion/extremeness seeking Framing Framing Priming Priming

The End