1. Designing the Questionnaire or Observation Form Chapter 12

2. Procedure for Developing a Questionnaire SLIDE 12-1 Step 1 Step 2 Step 3 Step 5 Step 4 Step 6 Step 7 Step 8 Step 9 Specify what information will be sought Determine type of questionnaire and method of administration Determine content of individual questions Determine form of response to each question Determine wording of each question Determine question sequence Determine physical characteristics of questionnaire Reexamine steps 1-7 and revise if necessary Pretest questionnaire and revise if necessary

3. Telescoping Error and Recall Loss SLIDE 12-2 TELESCOPING ERROR A type of error resulting from the fact that most people remember an event as having occurred more recently than it did. RECALL LOSS A type of error caused by a respondent’s forgetting that an event happened at all.

4. Randomized Response Model SLIDE 12-3 An interviewing technique in which potentially embarrassing and relatively innocuous questions are paired, and the question the respondent answers is randomly determined but is unknown to the interviewer.

5. Illustration of the Randomized Response Technique SLIDE 12-4 Interviewer: Please reach in the jar and pull out one of the colored balls, but do not show the ball to me. However, if the ball is blue, please answer question A on the card, whereas if it is red, please answer question B. Since I don’t know which colored ball you’ve drawn, I won’t know which question you’re answering. Respondent: Says yes. Questions: 1.Do we know if this respondent ever shoplifted? 2.Can we calculate the proportion of people in the sample who have shoplifted? Items handed to respondent 1.Is your birthday in January? 2.Have you ever shoplifted? Yes No Yes No

6. Suppose the proportion of people in the sample who answered yes was.20 and there were an even number of blue and red balls in the jar, say 50 of each. Let π = the total proportion of “yes” responses =.20 p = the probability that the sensitive question (the person has shoplifted) is being answered =.50 1-p = the profitability that the nonsensitive question (the person’s birthday is in January) is being answered =.50 π s = the proportion of “yes” responses to the sensitive question or the proportion of people who have shoplifted π NS = the proportion of “yes” responses to the nonsensitive question or the proportion of people whose birthday is in January; suppose census data indicate that π NS =.05 Now π = p π S + (1-p) π NS and.20 =.50 π S x +.50(.05) and π S =.35 Illustration of the Randomized Response Technique (Cont.) SLIDE 12-5

7. Open-Ended Questions SLIDE 12-6 1.How old are you? ______ 2.Do you think laws requiring passengers in motor vehicles to wear seat belts are needed? _____ 3.Can you name three sponsors of the Monday-night football games? _____ 4.Do you intend to purchase an automobile this year? _____ 5.Why did you purchase a Magnavox brand color television set? _____ 6.Do you own a VCR? _____

8. A fixed-alternative question in which respondents are asked to choose the alternative that most closely corresponds to their position on the subject. Example Age How old are you? Less than 20 20-29 30-39 40-49 50-59 60 or over Multichotomous Questions SLIDE 12-7

9. A fixed-alternative question in which respondents are asked to indicate which of the two alternative responses most closely corresponds to their position on the subject. Example Age Do you think laws requiring passengers in motor vehicles to wear seat belts are needed? Yes No Dichotomous Questions SLIDE 12-8

10. A technique used to combat response bias in which one phrasing is used for a question in one-half of the questionnaires while an alternate phrasing is used in the other one-half of the questionnaires. Split Ballot SLIDE 12-9 Example Do you think gasoline will be more expensive or less expensive next year than it is now? More expensive Less expensive Do you think gasoline will be less expensive or more expensive next year than it is now? More expensive Less expensive

11. A source of non-sampling error that arises when a respondent agrees to an interview but refuses, or is unable, to answer specific questions. Item Non-Response SLIDE 12-10

12. A question framed so as to give the respondent a clue as to how he or she should answer. Example Do you feel that limiting taxes by law is an effective way to stop the government from picking your pocket every payday? Yes No Undecided Leading Questions SLIDE 12-11

13. A problem that occurs when a question is not framed so as to explicitly state the consequences, and thus it elicits different responses from individuals who assume different consequences. Implicit Alternative SLIDE 12-12 Example Would you like to double the number of job offers you receive as a senior? Would you like to double the number of job offers you receive as a senior if that means devoting an additional 10 hours per week to studying so as to raise your grade point? YesNo YesNo

14. A question that calls for two responses and thereby creates confusion for the respondent. Double-Barreled Question SLIDE 12-13 Example Are the food and service at the local Pizza Hut good? YesNo

15. Use simple words and questions Avoid ambiguous words and questions Avoid leading questions Avoid implicit alternatives Avoid implicit assumptions Avoid generalizations and estimates Avoid double-barreled questions Guidelines for Question Wording SLIDE 12-14

16. Use simple, interesting opening questions Use the funnel approach, asking broad questions first Carefully design branching questions Ask for classification information last Place difficult or sensitive questions near the end Guidelines for Question Sequencing SLIDE 12-15

17. Funnel Approach An approach to question sequencing that gets its name from its shape, starting with broad questions and progressively narrowing down the scope. Example How would you rate your last experience when eating at ABC restaurant? Extremely Poor Poor So-So Good Good How would you rate the quality of the service? Extremely Poor Poor So-So Good Good Guidelines to Question Sequencing (Cont) SLIDE 12-16

18. Branching Question A technique used to direct respondents to different places in a questionnaire, based on their response to the question at hand. Guidelines to Question Sequencing (Cont) SLIDE 12-17

19. Branching Question Example 1. Please answer the following question Yes or No. Did you, personally, give money to Canopy of Care last year? Y or N {If Yes, go to #3.} 2.We are interested in why people do not contribute. The following is a list of answers others have given. Please tell me which, if any, apply to you. a. ___ Someone else in my household had already contributed. b. ___ I did not have the money at the time. c. ___ I gave to other charities. d. ___ I volunteered my services to Canopy of Care instead of contributing money. e. ___ I volunteered my services to other charities instead of contributing to Canopy of Care. f. ___ I did not give because Canopy of Care spends its money inefficiently. g. ___ None of the above. 3.To how many different charities do you think Canopy of Care gives money? a. ___ 0-20 d. 81-100 b. ___ 21-40e. More than 100 c. ___ 41-80f. Don’t know. Guidelines to Question Sequencing (Cont) SLIDE 12-18

20. Use of a questionnaire (or observation form) on a trial basis is a small pilot study to determine how well the questionnaire (or observation form) works. Pretest SLIDE 12-19