1. Research Design 10/3/2013

2. Graduate & Professional School Fair: Oct. 7 Explore Graduate, Law, Medical and Professional Schools THIS coming Monday! – Monday, October 7, 2013 – 10:30 a.m. – 1:30 p.m.. Mabee Ballrooms, 3 rd floor of the Ragsdale Center 48 schools & 2 test prep services will be participating.

3. Readings Chapter 4 Research Design and the Logic of Control (Pollock)

4. OPPORTUNITIES TO DISCUSS COURSE CONTENT

5. Office Hours For the Week When – Friday 10-12 – Monday 10-12 – And by appointment

6. Homework (Due today) Chapter 2 – Question 1: A, B, C, D, E – Question 2: B, D, E (this requires a printout) – Question 3: A, B, D – Question 5: A, B, C, D – Question 7: A, B, C, D – Question 8: A, B, C

7. Course Learning Objectives 1. First, students will learn the research methods commonly used in behavioral sciences 2.Students will learn the basics of research design and be able to critically analyze the advantages and disadvantages of different types of design.

8. What a Research Design Includes Unit of Analysis Variables Data Hypotheses Justification for your statistics

9. The Goal of A Research Design is to create a study that can demonstrate causality

10. INTERNAL VALIDITY OF RESEARCH DESIGN Working for Causality

11. Internal Validity Setting up Research Designs Properly Having control over the experiment. Especially the independent variable.

12. Threat 1:History You cannot account for all previous knowledge and events You cannot control for all potential independent variablesvariables

13. An Example

14. Threat 2: Maturation We get older We get wiser We get tired (short term) These are natural changes

15. Threat 3: Experimental Mortality Participants leave the research study Those who remain, may not be like the target group

16. Threat 4: Selection Bias Choosing the wrong sample Picking Respondents to favor your results Picking Respondents Excluding cases or respondents that do not fit your goals Using volunteers!

17. Threat 5: Instrumentation A Bad Measure Changing a Measure to Fit your Needs

18. Threat 6: Design Contamination People intentionally or unintentionally act differently “Instrument Reactivity” We Guess the test, we share informationinformation

19. Hawthorne Effect

20. Which of these are Most Common? History Maturation Contamination is the worst!

21. EXTERNAL VALIDITY Making it Generalizable

22. What is External Validity Can we generalize our research Does it apply to other populations, settings and times. Does the test apply to the real world

23. The Lowest Form “Remember when is the lowest form of conversation” conversation Personal experience is the weakest form of evidence Stories Hypothetical Examples

24. Unique Program Features/Location Can it only work in one place Does the artificial setting harm validity Creaming (popular with education policy)

25. Effects of Selection This is also a threat to internal validity Subjects in study are unrepresentative Using Volunteers Poorly Drawn Samples

26. Reactive Effects of Experiments Taking the experiment out to the real world Participants act differently because they know they are being studied Administrators work differently as well.

27. Replication Can You Reproduce your findings? Can others reproduce your findings?

28. Replication

29. Biggest problems of External Validity Failure to replicate the exam. The Lack of Real World-Applicability To increase external validity, increase your sample!

30. The Goal Is both kinds of validity. The Social Sciences do better on external than internal

31. Research Design Experimental vs. Non Experimental

32. Types of Designs Experimental (mirror the natural sciences Non-experimental- sacrifice internal for external

33. CLASSIC EXPERIMENTAL DESIGN

34. The Classic Experimental Design This design is the best way to demonstrate causality You have total control This has 4 key parts

35. Step 1- Random Selection and Assignment 1.Subjects are selected at random and assigned to an experimental or control Group – You cannot pick people who you want to be in the experiment – You have two equal groups of participants – This ensures an even baseline between your group

36. Step 2- A pre-test is given to both groups 2. A Pretest measuring the Dependent variable is given to each group

37. Step 3- The introduction of the independent variable 3.The experimental group receives the independent variable (test stimulus) and the control group does not

38. Step 4- A Post Test is Given 4.The researcher measures the dependent variable for both groups after the experimental stimulus is given.

39. What You want to show R= Random assignment O 1 & O2 Observation for the two groups at time 1 X =Introduction of the treatment for the experimental group O3 & O4 Observation of the two groups at time 2 Note change for the two groups (overtime and between)

40. This type of design is common In the natural sciences In Psychology In Food TestsTests

41. It is rare in Social Sciences Legal and Ethical Problems Historical Problems Reactivity Problems.