1. Investigating Free On-line Survey Tools for Use in a Business Statistics Class Joan Donohue University of South Carolina 1

2. Comparison of features in free on-line survey tools 1.FreeOnLineSurveys.com (UK) (same KwikSurveys.com) 2.QuestionPro.com (Seattle, WA) 3.SurveyMonkey.com (Palo Alto, CA) (same as Zoomerang, FluidSurveys) 4.SurveyGizmo.com (Boulder, CO) (only free for a 7-day trial) 5.SurveyNuts.com (France) 6.SoGoSurvey.com (Herdnon, VA) 7.ZohoSurvey.com (Pleasanton, CA) 8.Survio.com (Czech Republic) 9.SurveyPlanet.com (Santa Monica, CA) 10.SurveyFace.com (Australia) 11.Typeform.com (Spain) 12.Google Forms (Mountain View, CA) SurveyFace (somewhat crude), TypeForms (somewhat slow) and Google Forms are the only FREE products that allow exporting results directly into Excel. 2

3. Feature Comparison Chart 1. FreeOnLine Surveys 2. Question Pro 3. Survey Monkey 4. Survey Gizmo Year Started2001200219992006 # Surveys10/dayNo limit # Questions201210No limit # Responses Per Survey 50100 No limit Question Types971230 Download Results no Yes for 7 days Monthly Upgrade Cost (for exporting results, etc.) $10$15$26 Free for 7 days then $25 3

4. Feature Comparison Chart 5. Survey Nuts 6. So Go Survey 7. Zoho Survey 8. Survio Year Started2014200820132012 # SurveysNo limit 5 # Questions103015No limit # Responses Per Survey 100125150100 Question Types551215 Download Results no Monthly Upgrade Cost (for exporting results, etc.) $9$12$24$14 4

5. Feature Comparison Chart 9. Survey Planet 10. Survey Face 11. Type Form 12. Google Forms Year Started20112012 2008 # SurveysNo limit # QuestionsNo limit # Responses Per Survey No limit 200,000 Question Types109129 Download Results noYes Monthly Upgrade Cost (for exporting results, etc.) $15$0$20$0 5

6. Example Project From an Undergraduate Statistics Class Example Hypothesis: USC students who have a job and work at least 20 hours per week are more responsible than other students. This student would then develop 4 survey items to address whether someone is “responsible.” The items are answered using a 7-point Likert scale from Strongly Disagree to Strongly Agree. After collecting data, the student performs a 2-sample t-test to determine if the working students give higher mean responses. 6

7. Example Survey From an Undergraduate Statistics Class 7

8. 1. FreeOnLineSurveys.com 8

9. 9

10. 10 http://freeonlinesurveys.com/s/drgq2t5fucefvhc621583

11. 1. FreeOnLineSurveys.com Results are tabulated and displayed but cannot be exported to Excel. 11

12. 2. QuestionPro.com 12

13. 2. QuestionPro.com 13

14. 2. QuestionPro.com 14 http://www.questionpro.co/t/ALUnhZSMON

15. 3. SurveyMonkey.com 15

16. 3. SurveyMonkey.com 16

17. 3. SurveyMonkey.com 17 https://www.surveymonkey.com/r/FY7DBVY

18. 4. SurveyGizmo.com 18

19. 4. SurveyGizmo.com 19

20. 4. SurveyGizmo.com 20

21. 5. SurveyNuts 21

22. 5. SurveyNuts 22 http://surveynuts.com/surveys/take?id=19641&c=105275777RHJR

23. 6. SoGoSurvey 23

24. 6. SoGoSurvey 24 http://www.sogosurvey.com/survey.aspx?k=SsUTVTTsQsPsPsP&lang=0&data=

25. 7. Zoho Survey 25

26. 7. Zoho Survey 26 https://survey.zohopublic.com/zs/hpyTm2

27. 8. Survio 27

28. 8. Survio 28 http://www.survio.com/survey/d/Q3N5D6U8R8I4E2L4X

29. 9. Survey Planet 29

30. 30 https://surveyplanet.com/5648d9ac55d062b35010ed41 9. Survey Planet

31. 10. Survey Face 31

32. 32 https://www.surveyface.com/app/collector/webembed-js.php?sfu= ro980AnnStC0-WMKsbg5zoZUwKQFBqnR5i8N3xRAMc0 10. Survey Face

33. 33 10. Survey Face While this is a somewhat crude software tool, it does allow downloading data collected to an Excel file. Scale questions are not downloaded as numeric responses.

34. 11. TypeForm 34 Lots of features BUT very slow to use!!!

35. 11. TypeForm 35 https://donohuemoorescedu.typeform.com/to/dR7ZXr

36. 11. TypeForm 36 Allows downloading data collected to an Excel file. Scale questions are downloaded as numeric values and the scale can be started at 0 or 1.

37. 12. Google Forms 37

38. 12. Google Forms The default is to show link for submitting another response after completing survey. 38

39. 12. Google Forms Questions are not automatically numbered. Order can be randomized. Check “Required question” to avoid missing data. Numbering scale can start at 0 or 1 (no negative numbers) and the maximum is 10. Questions are not automatically numbered. 39

40. 12. Google Forms Choose Short URL then Ctrl-C to copy link to survey. It is better not to send the form via email since the survey will not be interactive. 40

41. 12. Google Forms I emailed the form to myself in both Outlook and Gmail – neither surveys were interactive. It’s probably better to send the link within an invitation email. 41

42. 12. Google Forms 42 http://goo.gl/forms/uFCjq5bIJRhttp://goo.gl/forms/uFCjq5bIJR​

43. 12. Google Forms 43

44. 12. Google Forms 44

45. 12. Google Forms 45

46. 12. Google Forms 46

47. 12. Google Forms Excel File with Downloaded Responses. 47

48. On-line Surveys Advantages and Disadvantages Advantages Environmentally friendly Filling out a survey using a mobile device seems preferable to college students Video and audio can be included Order of questions can be randomized Use email lists and easily send completion reminders Eliminates manual data entry Provide respondents with a link to the results Disadvantages Sampling issues – posting on social media will lead to self-selection bias, email lists could have selection bias Respondents can complete a survey more than once Generally need an internet connection to fill out survey and always need one for results to be collected 48

49. Sampling Issues When students print a paper copy of their surveys, they collect data across campus – hoping to obtain a simple random sample of USC students. With an on-line survey, I suggest that students use the on-line campus directory. They search the directory using randomly selected sequences of letters and obtain about 200 student email addresses. Then they email the survey link to them using BCC recipents. 49

50. Sampling Issues 50

51. Sampling Issues 51

52. Sampling Issues 52

53. Closing Comments 53 I required students to use the on-line survey tool for their Final Project for the first time last Spring. None of the students had used Google Forms before and most told me they thought it was a very useful tool to know about. None of the students had used the on-line campus directory to obtain a random sample of student email addresses and found my suggested approach to random sampling very easy to implement. Lastly, I think the students are getting more representative samples than when they used paper surveys (and were tempted just to ask friends to fill them out) and therefore, more meaningful results.