1. SOCI 2003B: Sociological Methods Colleen Anne Dell, Ph.D. Carleton University, Department of Sociology & Anthropology Canadian Centre on Substance Abuse November 16, 2006 Interviewing and Evaluation Research MODES OF OBSERVATION

2. OVERVIEW 1. Evaluation Research a. Key Aspects of Evaluation Research i. Possible topics ii. Designing evaluative research b. Experimental Designs i. Classic experiment ii. Quasi-experiment c. Limitations of evaluation research 2. Interviews a. Definition b. Advantages of interviews c. Constructing interview questions d. Interviewing techniques e. Essential components of interviewing

3. WORKSHOP Interviewing

4. 1. EVALUATION RESEARCH The systematic application of social science research procedures for assessing the conceptualization, design, implementation, and utility of social intervention programs (Babbie and Benaquisto). Evaluation research focuses on the research PURPOSE rather than the METHOD.

5. A.KEY ASPECTS OF EVALUATION RESEARCH

6. i) Possible Topics Social intervention: An action taken within a social context for the purpose of producing some intended result.

7. ii) Designing Evaluation Research a. Can the program be evaluated? b. Identify the program goals / Defining the program c. Measurement The researcher must be able to operationalize, observe and recognize the presence or absence of what is under study.

8. d. Specify outcomes e. Account for experimental contexts f. Specify interventions g. Specify other variables

9. B. EXPERIMENTAL DESIGNS

10. i) Classic Experiment design

11. ii) Quasi-Experiment design Lack of random assignment of subjects to an experimental and a control group. a) Time Series b) Non-equivalent control groups c) Multiple time series design d) Qualitative evaluations

12. C. LIMITATIONS OF EVALUATION RESEARCH As you review reports of applied studies, you should be especially sensitive to these problems (Babbie and Benaquisto) 1. Logistical problems 2. Ethical issues 3. Researcher Responsibility 4. Research Stakeholders

13. 2. INTERVIEWS

14. A. Definition A data collection encounter in which one person (an interviewer) asks questions of another (a respondent) (Babbie and Benaquisto) A qualitative interview is essentially a conversation in which the interviewer establishes a general direction for the conversation and pursues specific topics raised by the respondent (Kirby and McKenna)

15. B. Advantages of Interviews

16. C.Constructing Interview Questions

17. D. Interviewing techniques A. Interviewer Qualities…. understanding, accepting, non-judgmental, straightforward, honest, sense of humour, reassuring, relaxed, calm, friendly, intelligent, adjusted, secure, patient, experienced in life, quiet, gentle, sympathetic interested, caring, focused B. Appearance & Demeanor C. Familiar with the Questionnaire

18. D. Follow Wording Exactly E. Record Answers / Responses Exactly F. Probe for Responses G. Listening Skills

19. NEVER THINK YOU KNOW THE LAST WORD ON ANY HUMAN HEART -- HENRY JAMES

20. E.Essential components of interviewing (Kirby & McKenna) - Egalitarian setting and relationship between the interviewer and the participant - Identify your research approach to the research participant at first contact - Recognize the investment made by all: participants, researchers and others - Account for yourself - The researcher must experience the interview as both an interviewer and a research participant ------early on in the data gathering process - The research process is dynamic – continually changing in response to new information and new participants