1. Nuts & Bolts of Online Surveys PRISM Brownbag April 24, 2009 Delia Dumitrescu (dumitrescu.5@polisci.osu.edu)

2. Why Online Surveys? Cheap research opportunity Cheap research opportunity Boost data obtained through interviews Boost data obtained through interviews Possibility for experimental work Possibility for experimental work Virtually unlimited cross-national comparisons Virtually unlimited cross-national comparisons Widespread internet access  access to difficult-to-reach populations Widespread internet access  access to difficult-to-reach populations

3. Online Survey Companies http://www.wac.ohio- state.edu/workshops/survey_of_surv eys/ http://www.wac.ohio- state.edu/workshops/survey_of_surv eys/ http://www.wac.ohio- state.edu/workshops/survey_of_surv eys/ http://www.wac.ohio- state.edu/workshops/survey_of_surv eys/ Survey Gizmo (free package) Survey Gizmo (free package) Survey Monkey (free package) Survey Monkey (free package) Zoomerang (free package, but data kept for limited number of days) Zoomerang (free package, but data kept for limited number of days) Lime Survey (free altogether) Lime Survey (free altogether) Checkbox Checkbox Snap Survey Snap Survey

4. Survey Gizmo: Question Types Virtually every type of question Virtually every type of question Single response (e.g. Likert) Single response (e.g. Likert) Multiple responses Multiple responses Tables of questions Tables of questions Ranking Ranking Visual comparison Visual comparison Text/Essay Text/Essay http://www.surveygizmo.com/ s/124603/prism http://www.surveygizmo.com/ s/124603/prism http://www.surveygizmo.com/ s/124603/prism http://www.surveygizmo.com/ s/124603/prism

5. Questions: Practical Issues Question randomization on page Question randomization on page Option randomization Option randomization Trigger questions + Trigger questions + Hidden questions on page Hidden questions on page Required questions Required questions Question editing: Question editing: Coding Coding Text – Beware of copy/pasting MS Word Text – Beware of copy/pasting MS Word

6. Question Editing

7. Question Randomization

8. Likert Scales

9. Likert Scales (cont’d)

10. Trigger Questions

11. Option Randomization

12. Trigger Window

13. Table Questions

14. Table Questions (Cont’d)

16. Rankings (Cont’d)

18. Ranking (Cont’d)

19. Image choice

20. Image choice (Cont’d)

21. Essay Questions

22. Essay Questions (Cont’d)

23. Overall Survey: Practical Issues Skip pages Skip pages Branching Branching Appearance Appearance Colors/ Fonts Colors/ Fonts Languages Languages Forward only surveys Forward only surveys Informing subjects on progress Informing subjects on progress IMPORTANT: check that survey is working on multiple OS IMPORTANT: check that survey is working on multiple OS

24. Survey Customization

25. Survey Customization (Cont’d)

28. Data: Practical Issues Quick reports: frequencies & graphs Quick reports: frequencies & graphs http://app.sgizmo.com/reports/27 611/127173/AT073EN6RSYBL3R A1Q8KW7642Y5RSU/?ts=124050 8336 http://app.sgizmo.com/reports/27 611/127173/AT073EN6RSYBL3R A1Q8KW7642Y5RSU/?ts=124050 8336 http://app.sgizmo.com/reports/27 611/127173/AT073EN6RSYBL3R A1Q8KW7642Y5RSU/?ts=124050 8336 http://app.sgizmo.com/reports/27 611/127173/AT073EN6RSYBL3R A1Q8KW7642Y5RSU/?ts=124050 8336 Format: csv Format: csv Checking for multiple responses: Checking for multiple responses: Cookies? Cookies? Respondent ID Respondent ID

29. Increasing Respondents’ Confidence Login from polisci website Login from polisci website http://polisci.osu.edu/grads/ddum itrescu/survey_info.htm http://polisci.osu.edu/grads/ddum itrescu/survey_info.htm http://polisci.osu.edu/grads/ddum itrescu/survey_info.htm http://polisci.osu.edu/grads/ddum itrescu/survey_info.htm How to send mass e-mails (and avoid the dangers of “spamming”): How to send mass e-mails (and avoid the dangers of “spamming”): “Send personally” “Send personally” E-mail groups E-mail groups

30. Resources Prism brownbag survey on the intra-net (pdfs) Prism brownbag survey on the intra-net (pdfs) Surveygizmo.com – tutorials, FAQs, forum (replies within a reasonable time delay) Surveygizmo.com – tutorials, FAQs, forum (replies within a reasonable time delay) Survey questionnaire design: Survey questionnaire design: PS 702! PS 702! The Psychology of Survey Response (2000) The Psychology of Survey Response (2000) Asking Questions... (2004) Asking Questions... (2004) Online surveys: Mail & Internet Surveys (2007) Online surveys: Mail & Internet Surveys (2007)

31. Conclusions Inexpensive and time effective method of data collection Inexpensive and time effective method of data collection Significant resources out there to help with the design of effective web surveys Significant resources out there to help with the design of effective web surveys Potential liabilities: respondent interest in the survey (loss of focus), respondent identity, multiple responses Potential liabilities: respondent interest in the survey (loss of focus), respondent identity, multiple responses