1. Unit 7 - Seminar Survey & Data Collections Professor Chris Lim, MA, Ph.D.(ABD) Undergraduate School of Criminal Justice Email: SLim@kaplan.edu

2. Stanford Prison Experiment Unit 4 Activity Your Name CJ490 Research Method in CJ Kaplan University 2

3. Brief Review of Stanford Research Experiment 3

4. The Purpose of the Study: 4

5. Research Design Used? 5 Why Did the Researcher chose This Design?

6. Four Ethical Standard Used from Chapter 2 6

7. Ethical Standard 7

8. Author’s Opinion 8

9. Analysis of Generalizability 9

10. References 10 Arakji, R. Y., & Lang, K. R. (2008). Avatar business value analysis: A method for the evaluation of business value creation in virtual commerce. Journal of Electronic Commerce. Research, 9, 207-218. Bower, B. (2008, Feb. 9). Dawn of the city: Excavations prompt a revolution in thinking about the earliest cities. Science News, 173(6), 90-92. Retrieved from http://www.sciencenewsmagazine.org/ Klimoski, R., & Palmer, S. (1993). The ADA and the hiring process in organizations. Consulting Psychology Journal: Practice and Research, 45(2), 10-36. doi:10.1037/1061-4087.45.2.10

11. Surveys in CJ Research Purpose Versatility  Can be designed to study almost any social issue  Can learn about individuals and organizations Efficiency Data can be collected from a large number of people relatively inexpensively and quickly Generalizability Most effective way to obtain information from representative sample of large population

12. Basic Terms in Survey Research Survey Research Questionnaire Interview schedule Respondent Response Rate

13. Questionnaire Development Part of a questionnaire Questions are interpreted Give very careful attention Maintain consistent focus

14. Organization of Questionnaire Create a title that is descriptive of overall topic Make sure question order does not influence responses Create major topic divisions to help respondents understand organization of questionnaire Use instructions throughout questionnaire to minimize respondent confusion Questionnaire should look attractive, be easy to complete, and have open space Use numbers to designate response choices, for ease of coding and data entry Create introductory material that will enhance response rate

15. Questionnaire Development Clear conception of research program and population being studies Be sure to include relevant questions and exclude irrelevant ones Build on existing instruments Other researchers may have designed questions to measure key concepts in your study Can improve reliability and validity of your questionnaire

16. Steps of Writing Survey Cover Letter, not Title page Target your respondents/audience Population Sampling Allow the Respondents to expand or make comments Ethical Standard Your paper should be 3 -4 pages in length Final Section: Statement of Pretesting Results

17. Writing Survey Questionnaires Title the Survey Provide Instructions to each type of questionnaires Do not make the survey longer than it needs to be Write Clear and Meaningful Questions Avoid Confusing Phrasing Minimize the Risk of Bias Avoid Making Either Disagreement or Agreement Disagreeable Inform the respondents of the survey end date Remember to say “Thank you”

18. The “Full” Pretest Draw small sample of individuals from the population you are studying or one very similar to it Try out the survey procedures with them Review responses to each question Listen to audio recordings and/or read comments by respondents and interviewers Revise any questions that respondents do not seem to interpret as you had intended or that are not working well for other reasons If response rate is relatively low, decide whether modifications in procedures might improve it

19. Data Collections Depends on the Research Topic Variables to be measured  IV=Cause & DV=Effect  Hypothesis Survey method Qualitative or Quantitative Field Survey Focus Group Interview

20. Focus Groups and Panel Survey Open-ended interviews Focus group - guided discussion among potential respondents Panel Surveys Direct observations

21. Self-Administered Survey to Collect Data Group  Mail  Self  Electronic Email Internet Computer Assisted Self Interview (CASI) Interactive Voice Response (IVR) Can also be administered individually Respondents fill in answers on their own Most economical way to survey large number of people, especially if population is geographically spread out In electronic surveys, may not know representativeness of sample

22. Response Rate Always aim for 100%, but rarely achieve it  Minimum acceptable generally considered to be around 70% Different types of surveys have different response rate characteristics Techniques exist to maximize response rate Many of the guidelines for survey design are intended to increase response rate

23. Telephone Surveys and In-Person Interviews Interviewers question respondents over the phone and record answers  Often use Computer Assisted Telephone Interviewing (CATI) Very popular because almost all households have phones Random digit dialing (RDD) Types  Manual or Computer Assisted Personal Interview (CAPI)  Survey may be called “interview schedule” Have better quality data than mail surveys  Interviewer can clarify unclear items  Interviewer can “probe” for open-ended responses Usually requires extensive training

24. Electronic Surveys Email  Sent as messages to respondent’s email address Internet-based  Designed on a server controlled by researcher  Can be longer than email surveys and have inapplicable questions hidden from respondent’s view  Flexible format  Interactive Voice Response (IVR) Respondent receives automated phone call from ‘computer’ and answers questions by pressing numbers on phone keypad or speaking answers Best suited to specific populations known to have email and internet access

25. Combining Survey Designs Mixed-Mode Surveys  Allow strength of one design to compensate for weakness of another  Modes selected depend upon population being surveyed Adding Qualitative Data Adding Data from Records

26. Face-to-Face vs. Telephone Surveys Face-to-face  Highest response rate  Most expensive, especially if geographically spread out  Can be easy to make up responses, especially in field interviews  Interviewers can make observations about interview setting or environment Telephone  Highest response rate for lowest cost  Interviewers can be more closely supervised than in in-person interviews  Safer for interviewers

27. Advantages/Disadvantages of Each Survey Type Researchers assess the advantages and disadvantages of each type of survey in terms of  Representativeness of the sample  Questionnaire construction and question design  Distortion of answers  Administrative goals of project The next few slides summarize the advantages and disadvantages of each survey type

28. Ethical Issues Dealing with Sensitive Subjects  Self-report of criminal or deviant behavior  Alternative methods for answering questions Separate answer forms CAPI Web-based studies  May be designed to be anonymous, but researcher cannot guarantee absolute anonymity Harm  Most harm in survey research arises from breach of confidentiality  Some surveys may cause psychological harm

29. Unlocking the Keys to Success! Please remember to contact me if you have questions or if you need help with anything. Each class you successfully complete unlocks another piece of your future! Have a great term and I look forward to working with all of you!

30. Thank you for your participation! Don’t forget to do your assignments and submit them promptly. See you next week and have a great week!