1. Surveys Questionnaires & Interviews Electronic Methods

2. Survey Error

3. Types of Surveys  Self-administered (questionnaire)  Telephone  On-line  Interviews

4. Statements vs Questions  Statements are most often used when the research anticipates composite score development  Questions open-end (easy to do, difficult to manage in analysis) closed-ended (fixed) response (requires more attention in the development – easier to manage in analysis

5. Criteria for Statement/Question Development  Clear – neither vague or ambiguous  Avoid “Double Barreled” questions  Respondents must be competent  Respondents must be willing  Questions must be relevant  Shorter is better  Avoid “negative” items  Avoid biased items/terms

6. Questionnaire format  Introduction – completion time  White space  Literacy level  Organized  Easy to follow  Demographics at the end  Return address/Contact Person  THANK YOU

7. Formats  Use “boxes”     Contingency Questions  Matrix Questions  Appearance (bold, highlight, Caps, etc.)  Order – logical (general first – open- ended first)  Avoid “staples” (use 11 x 17 paper folded instead of stapling two 8.5 x 11)

8. PRE-TEST  PRE-TEST

9. MAIL QUESTIONNAIRES  ANONYMOUS vs CONFIDENTIAL  COVER LETTER  RETURN ENVELOP OR ADDRESSED AND POSTPAID QUESTIONNAIRE  REMINDER CARD  FOLLOW-UP MAILING  MONITOR RESPONSES – (return rate: 50%=C, 60%=B, 70% or more=A)

10. INTERVIEWS  Interviewing is “interaction” and the interviewer may effect the data: Begins with the survey form and an “interviewer guide” and “respondent’s material” Interviewer training – including practice interviews Recording responses, probes vs clarification, field editing

11. ALTERNATIVE SURVEY METHODS  Computer-Assisted Telephone Surveys (CATI)  Computer-Assisted Personal Interviews (CAPI)  Computer-Assisted Self-Interviews (CASI)  Computerized Self-Administered Questionnaire (CSAQ)  Touchtone Data Entry (TDE)  Voice Recognition (VR)

12. Surveys vs Questionnaires  Surveys Large amount of data can be collected More detailed data Fewer incomplete forms Higher return rates Flexibility in sampling Fewer misunderstood questions  Questionnaires Economy Speed Lack of interviewer bias Anonymity & Privacy

13. QUESTION GUIDELINES Prior Questions

14.  SHOULD YOU DO THE STUDY?  WHO WILL USE THE DATA?  HOW WILL THE DATA BE USED?  WHAT DATA NEED TO BE COLLECTED?  WHO WILL SUPPLY THE DATA?  HOW WILL THE DATA BE ANALYZED?

15. MEASUREMENT IDEAS  INTERVIEW POTENTIAL USERS  REVIEW LITERATURE  INTERVIEW SAMPLE OF RESPONDENTS  BRAIN-STORMING

16. CRITERIA FOR QUESTIONS  CLARITY LENGTH SPECIFICITY UNIDIMENSIONALITY WORD CHOICE

17. Criteria for Questions (cont)  BIAS  SENSITIVITY  REDUNDANCY  PURPOSEFULNESS  OMNISCIENCE

18. THE RESPONSES: Open-Ended  PILOT STUDIES  LESS BIASED  VARIETY OF RESPONSES  INTRODUCE NEW TOPICS  RESPONDENTS “HAVE THEIR SAY”  BACKGROUND FOR INTERPRETATION  “LIFE & CREDIBILITY”

19. THE RESPONSES: Fixed-choice  UNIFORM STIMULI  EASY & QUICK TABULATION  NOT DEPENDENT UPON WRITING ABILITY OF RESPONDENTS  LESSEN PROBLEMS OF VOCABULARY  MORE QUESTIONS ASKED  EASIER FOR PEOPLE TO COMPLETE