Questionnaire and Form Design MKTG 3350: MARKETING RESEARCH Yacheng Sun Leeds School of Business 1 Dr. Yacheng Sun, UC Boulder.

Slides:



Advertisements
Similar presentations
This ad from Greenfield Online suggests that well-executed research can save a company from making a costly mistake on new product introductions.
Advertisements

Questionnaire & Form Design
2.06 Understand data-collection methods to evaluate their appropriateness for the research problem/issue.
Business Research Methods William G. Zikmund
Questionnaire & Form Design
Designing and Analyzing Questionnaires
Dr. Michael R. Hyman, NMSU Writing Good Questions.
Questionnaire Design.
Chapter 9 Descriptive Research. Overview of Descriptive Research Focused towards the present –Gathering information and describing the current situation.
Determining the Order of Questions
Designing the Questionnaire. Logical Steps to Develop a Good Questionnaire Recall the research objective, the research questions and hypotheses Identify.
The Questionnaire Development Process
CHAPTER eleven Questionnaire Design Copyright © 2002
Business and Management Research
DESCRIPTIVE RESEARCH DESIGN Descriptive Research involves systematic collection of information from respondents for the purpose of understanding.
Questionnaire and Form Design
Exploring Marketing Research William G. Zikmund Chapter 15: Questionnaire Design.
Questionnaire & Form Design. Specify the Information Needed Design the Question to Overcome the Respondent’s Inability and Unwillingness to Answer Determine.
Questionnaire & Form Design
QUESTIONNAIRE DESIGN. 1. What should be asked? 2. How should questions be phrased? 3. In what sequence should the questions be arranged? 4. What questionnaire.
Questionnaire Design. “It is not every question that deserves an answer.” Publius Syrus (Roman, 1st century B.C.)
Marketing Research Aaker, Kumar, Day Seventh Edition Instructor’s Presentation Slides.
Data Collection Methods
A. Parichart W. A. Chulamani C..  To describe how to design the questionnaire; introduction, question order, layout, and question length.  To explain.
Chapter 29 conducting marketing research Section 29.1
Chapter Eleven Chapter 11.
Chapter Eleven. Lecture Plan Questionnaire Definition Questionnaire Design Process Questionnaire Objectives.
Copyright © 2000 by Harcourt, Inc. All rights reserved. Business Research Methods William G. Zikmund Chapter 15: Questionnaire Design.
CHAPTER 11 DESIGNING DATA COLLECTION FORMS. The Questionnaire Development Process Determine Survey Objectives and Constraints Determine Survey Objectives.
CHAPTER 11 – QUESTIONNAIRE DESIGN Zikmund & Babin Essentials of Marketing Research – 5 th Edition © 2013 Cengage Learning. All Rights Reserved. May not.
© 2009 Pearson Education, Inc publishing as Prentice Hall 11-1 Questionnaire and Form Design Istijanto, MM, MComm Handyanto Widjojo, MM.
Chapter 11 Questionnaire & Form Design Chapter Outline 1) Overview 2) Questionnaire & Observation Forms i.Questionnaire Definition ii.Objectives.
Copyright © 2010 Pearson Education, Inc Chapter Ten Questionnaire & Form Design.
Questionnaire Design.  Ensures standardization and comparability of the data across interviews  Increases speed and accuracy of recording  Facilitates.
Learning Objectives Copyright © 2004 John Wiley & Sons, Inc. Questionnaire Design CHAPTER Nine.
Chapter Nine Copyright © 2006 John Wiley & Sons, Inc. Questionnaire Design.
10 Questionnaire Design. Role of Questionnaire Survey research, by definition, relies on the use of a questionnaire. A questionnaire is a set of questions.
Questionnaire & Form Design Questionnaire Definition A questionnaire is a formalized set of questions for obtaining information from respondents.
Chapter X Questionnaire and Form Design. Chapter Outline Chapter Outline 1) Overview 2) Questionnaire & Observation Forms i. Questionnaire Definition.
10-1 Questionnaire & Form Design Questionnaire Definition A questionnaire is a formalized set of questions for obtaining information from respondents.
Guidelines for Writing Surveys A number of resources available ◦ Survey Research by Backstrom and Hursh- Casar ◦ Survey Research Methods by Fowler.
Chapter Eight Questionnaire Design Chapter Eight.
Creating A Good Questionnaire IB Geography. Advantages and Disadvantages of Questionnaires Advantages –Can assess a large group quickly –Easy to analyze.
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Questionnaire Design CHAPTER eleven.
Descriptive Research & Questionnaire Design. Descriptive Research Survey versus Observation  Survey Primary data collection method based on communication.
© Associate Professor Dr. Jamil Bojei, 2007 Questionnaire DesignSlide 1.
Questionnaire & Form Design
Questionnaire & Form Design. Questionnaire Definition A questionnaire is a formalized set of questions for obtaining information from respondents.
Essentials of Marketing Research Kumar, Aaker, Day Chapter Ten Designing the Questionnaire.
© 2009 Pearson Education, Inc publishing as Prentice Hall 11-1 Chapter 11 Questionnaire and Form Design.
Section 29.1 Marketing Research Chapter 29 conducting marketing research Section 29.2 The Marketing Survey.
Questionnaire Design. What is a questionnaire?  Formalized schedule for collecting data from respondents Outlines information to be gathered Key criteria.
Chapter Ten Questionnaire & Form Design Chapter Outline 1) Overview 2) Questionnaire & Observation Forms i.Questionnaire Definition ii.Objectives.
Questionnaire Design.
Questionnaire & Form Design
Questionnaire and Form Design
Introduction to Marketing Research
Survey (Questionnaire and Interview)
Questionnaire & Form Design
About Market Research Making a Questionnaire
Chapter Eleven Chapter 11.
Chapter Eleven Chapter 11.
Questionnaire & Form Design
Questionnaire and Form Design
Questionnaire Development
10 Questionnaire And Form Design
Questionnaire & Form Design
Questionnaire Design.
Questionnaire & Form Design
Questionnaire & Form Design
Presentation transcript:

Questionnaire and Form Design MKTG 3350: MARKETING RESEARCH Yacheng Sun Leeds School of Business 1 Dr. Yacheng Sun, UC Boulder

3

Today’s Agenda –How to formulate good questions –Flow and Layout of Questionnaire –Evaluate/Pretest Questionnaire 4

Marketing Research = Science + [Art] Information Needs Information Needs Research Design Research Design Measurement/Scaling Measurement/Scaling Information Needs Information Needs Research Design Research Design Measurement/Scaling Measurement/Scaling Data Collection Data Collection Data Analysis Data Analysis Data Collection Data Collection Data Analysis Data Analysis Questionnaire A questionnaire is a formalized set of questions for obtaining information from respondents. 5

Questionnaire Objectives It must translate the information needed into a set of specific questions that the respondents can and will answer. A questionnaire must uplift, motivate, and encourage the respondent to become involved in the interview, to cooperate, and to complete the interview. A questionnaire should minimize response error

A Good Questionnaire Appears as easy to compose as a good poem But, usually the result of long, painstaking work

Developing a Questionnaire No hard and fast rules Only guidelines

A QUESTIONNAIRE IS ONLY AS GOOD AS THE QUESTIONS IT ASKS 9

How to Write Question Individual Question Content Choosing Response Format Choose Question Wording 10

Individual Question Content Is the Question Necessary? If there is no satisfactory use for the data resulting from a question, that question should be eliminated. 11

Individual Question Content (1) Do the respondent have ability to give the information that we need ? information that we need ? (2) Do the respondents have the willingness to give answer ? answer ? (3) Are several questions needed instead of one ? 12

Overcoming Inability To Answer Can the Respondent Remember? How many gallons of soft drinks did you consume during the last four weeks? (Incorrect) How often do you consume soft drinks in a typical week?(Correct) 1. ___ Less than once a week 2. ___ 1 to 3 times per week 3. ___ 4 to 6 times per week 4. ___ 7 or more times per week 13

Overcoming Unwillingness To Answer Please list all the departments from which you purchased merchandise on your most recent shopping trip to a department store. (Incorrect) In the list that follows, please check all the departments from which you purchased merchandise on your most recent shopping trip to a department store. 1.Women's dresses____ 2.Men's apparel____ 3.Children's apparel____ 4.Cosmetics____ Jewelry____ 17. Other (please specify)____ (Correct) 14

Overcoming Unwillingness To Answer Increasing the Willingness of Respondents Place sensitive topics at the end of the questionnaire. Preface the question with a statement that the behavior of interest is common. Ask the question using the third-person technique (see Chapter 5): Phrase the question as if it referred to other people. Hide the question in a group of other questions which respondents are willing to answer. The entire list of questions can then be asked quickly. Provide response categories rather than asking for specific figures. Use randomized techniques. 15

Individual Question Content Are Several Questions Needed Instead of One? Sometimes, several questions are needed to obtain the required information in an unambiguous manner. Consider the question, “Do you think Coca-Cola is a tasty and refreshing soft drink?” (Incorrect) Such a question is called a double-barreled question, because two or more questions are combined into one. To obtain the required information, two distinct questions should be asked: “Do you think Coca-Cola is a tasty soft drink?” and “Do you think Coca-Cola is a refreshing soft drink?” (Correct) 16

Figure 11.4 Types of Questions Unstructured Questions Structured Multiple Choice DichotomousScales 17

Choosing Question Structure Unstructured Questions Unstructured questions are open-ended questions that respondents answer in their own words. Do you intend to buy a new car within the next six months? __________________________________ 18

Choosing Question Structure Structured Questions Structured questions specify the set of response alternatives and the response format. A structured question may be multiple-choice, dichotomous, or a scale. 19

Choosing Question Structure Multiple-Choice Questions In multiple-choice questions, the researcher provides a choice of answers and respondents are asked to select one or more of the alternatives given. Do you intend to buy a new car within the next six months? ____Definitely will not buy ____Probably will not buy ____Undecided ____Probably will buy ____Definitely will buy ____Other (please specify) 20

Choosing Question Structure Dichotomous Questions A dichotomous question has only two response alternatives: yes or no, agree or disagree, and so on. Often, the two alternatives of interest are supplemented by a neutral alternative, such as “no opinion,” “don't know,” “both,” or “none.” Do you intend to buy a new car within the next six months? _____ Yes _____ No _____ Don't know 21

Choosing Question Structure Scales Scales were discussed in detail in Chapters 8 and 9: Do you intend to buy a new car within the next six months? DefinitelyProbablyUndecidedProbablyDefinitely will not buywill not buywill buywill buy

Choosing Question Wording Define the Issue Define the issue in terms of who, what, when, where, why, and way (the six Ws). Who, what, when, and where are particularly important. Which brand of shampoo do you use?(Incorrect) Which brand or brands of shampoo have you personally used at home during the last month? In case of more than one brand, please list all the brands that apply.(Correct) 23

Poor Questions 24

25

26

Be Clear and Precise 27

28

29

30

31

Leading version: Do you believe that private citizens have the right to own firearms to defend themselves, their families, and property from violent criminal attack? YesNoUndecided Improved version: Do you believe that a ban on the private ownership of firearms would significantly reduce the number of murders and robberies in your community? YesNoUndecided Avoid Leading Questions 32

Choosing Question Wording Avoid Implicit Alternatives An alternative that is not explicitly expressed in the options is an implicit alternative. 1.Do you like to fly when traveling short distances? (Incorrect) 2.Do you like to fly when traveling short distances, or would you rather drive? (Correct) 33

Choosing Question Wording Use Ordinary Words “Do you think the distribution of soft drinks is adequate?” (Incorrect) “Do you think soft drinks are readily available when you want to buy them?”(Correct) 34

Questionnaire Organization Logical flow Usually go from general to specific Ask sensitive questions later 35

Typical Layout of a Questionnaire (I) Cover letter/Introduction Screening questions at the beginning. “Do you own X?” Interesting and simple questions next (“warm-ups”). “What brand of X do you own?” Involving questions in the middle. “Please rate X on the following 10 characteristics using the scale below.” 36

Typical Layout of a Questionnaire (II) Possibly insert “prompters” “Now that you have helped us with those comments, we would like to ask a few more questions.” Threatening and sensitive questions near the end Classification (demographic) questions in the end Finally, have a “Thank You” 37

Determining the Order of Questions Logical Order The following guidelines should be followed for branching questions: The question being branched (the one to which the respondent is being directed) should be placed as close as possible to the question causing the branching. The branching questions should be ordered so that the respondents cannot anticipate what additional information will be required. 38

Broad or General Questions Narrow or Specific Questions Figure 11.5 The Funnel Approach to Ordering Questions 39

40

Filter Question 41

Special Concerns Cover Letter/Introduction General Layout Ordering Effect Branching/Skip Pattern Position of Open-Ended Question Pre-coding Questions 42

Cover Letters 43

Possible Cover Letter Appeals 44

45

Guidelines for Cover Letters Indicate bona fide survey Identify ‘sponsor’ early in process Describe survey’s purpose clearly and simply Indicate how prospective respondents selected Solicit prospective respondent’s help 46

Layout 47

Bad Layout 48

Better Layout 49

Ordering Effect 50

Ordering Effect The answer to a particular question is influenced by the context of previous questionsThe answer to a particular question is influenced by the context of previous questions It is ubiquitousIt is ubiquitous It is impossible to totally avoidIt is impossible to totally avoid 51

Ordering Effect: An Example Q5: Are there more programs that include too much violence and brutality much violence and brutality Q6: Should big advertisers demand higher standards of program quality standards of program quality Q7: Should federal funding for public TV be increased, cut, or kept at current level? increased, cut, or kept at current level? 52

Another Example of Ordering Effect Questions Preceding % said “very Buying Interest Question much interested” in buying 1. No question asked 2. Asked only about advantage 3. Asked only about disadvantage 4. Asked about both advantage and disadvantage and disadvantage 53

Another Example of Ordering Effect Questions Preceding % said “very Buying Interest Question much interested” in buying 1. No question asked Asked only about advantage Asked only about disadvantage Asked about both advantage 5.7 and disadvantage 54

Overcome Ordering Effect Funnel Sequence –From general to specific Inverse Funnel Sequence –From specific to general 55

Branching/Skip Patterns 56

57

Branching/Skip Pattern Do not use branching unless it is absolutely necessaryDo not use branching unless it is absolutely necessary Interviewers should have sufficient practice before going to field with branching questionsInterviewers should have sufficient practice before going to field with branching questions Used less often in mail survey than in other types of surveysUsed less often in mail survey than in other types of surveys Computerized survey makes it easy to implement branching. However, still do not overuse itComputerized survey makes it easy to implement branching. However, still do not overuse it 58

Use multiple visual elements to improve skip pattern compliance 59

Pre-testing Decisions What items should be pre-tested? How should pre-test be conducted? Who should conduct pre-test? Who should be respondents in pre-test? How large should sample be for pre- test? 60