Lecture 10 Psyc 300A. Types of Experiments Between-Subjects (or Between- Participants) Design –Different subjects are assigned to each level of the IV.

Slides:



Advertisements
Similar presentations
Agenda Group Hypotheses Validity of Inferences from Research Inferences and Errors Types of Validity Threats to Validity.
Advertisements

Validity (cont.)/Control RMS – October 7. Validity Experimental validity – the soundness of the experimental design – Not the same as measurement validity.
Defining Characteristics
The Basics of Experimentation I: Variables and Control
1 Chapter 6: The Internal Validity of Research p.157 Confounds Threats to Internal Validity Reactivity Demand Characteristics Experimental Expectancies.
Experimental Research Designs
Correlation AND EXPERIMENTAL DESIGN
Research Design and Validity Threats
EXPERIMENTAL DESIGNS Criteria for Experiments
Quasi-Experimental Designs
EXPERIMENTAL DESIGNS What Is Required for a True Experiment? What Are the Independent and Dependent Variables? What Is a Confounding Variable? What Are.
Lecture 17 Psyc 300A. HW 8: Setting Up a Factorial ANOVA Serve Other Serve Other Serve Self Serve Self Alone With Another
Questions What is the best way to avoid order effects while doing within subjects design? We talked about people becoming more depressed during a treatment.
Lecture 12 Psyc 300A. Review: Inferential Statistics We test our sample recognizing that differences we observe may be simply due to chance. Significance.
RESEARCH METHODS Lecture 35. EXPERIMENTAL RESEARCH [CONTINUED]
RESEARCH METHODS Lecture 34. EXPERIMENTAL RESEARCH.
Chapter 9 Experimental Research Gay, Mills, and Airasian
Basic Principles of Research Design
Experiments and Observational Studies.  A study at a high school in California compared academic performance of music students with that of non-music.
EVALUATING YOUR RESEARCH DESIGN EDRS 5305 EDUCATIONAL RESEARCH & STATISTICS.
Experimental Research Take some action and observe its effects Take some action and observe its effects Extension of natural science to social science.
Chapter 8 Experimental Research
Experimental Design The Gold Standard?.
Research Tools and Techniques
I want to test a wound treatment or educational program in my clinical setting with patient groups that are convenient or that already exist, How do I.
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
Experimental Research Validity and Confounds. What is it? Systematic inquiry that is characterized by: Systematic inquiry that is characterized by: An.
12 Experimental Control and Internal Validity What are the potential threats to the validity of research? What is experimental control? What effect do.
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Primary Data Collection: Experimentation CHAPTER eight.
Techniques of research control: -Extraneous variables (confounding) are: The variables which could have an unwanted effect on the dependent variable under.
Validity RMS – May 28, Measurement Reliability The extent to which a measurement gives results that are consistent.
1 Experimental Research Cause + Effect Manipulation Control.
1 Evaluating Research This lecture ties into chapter 17 of Terre Blanche We know the structure of research Understand designs We know the requirements.
Experimental Designs. Experiments are conducted to identify how independent variables influence some change in a dependent variable.
Chapter 3.1.  Observational Study: involves passive data collection (observe, record or measure but don’t interfere)  Experiment: ~Involves active data.
PSY 330 Lect 6 1 Research strategies Research strategy: approach used to answer a research question. Non-experimental strategy Descriptive research strategy.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Introduction section of article
Experimental Research
Chapter 6 Research Validity. Research Validity: Truthfulness of inferences made from a research study.
Chapter 10 Experimental Research Gay, Mills, and Airasian 10th Edition
12 ©2013 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Chapter Six: The Basics of Experimentation I: Variables and Control.
Reliability and Validity Research Methods. RECAP! OBSERVATIONAL METHODS  Create 3 behavioural categories for the following: - Observation of students.
Experimental Research Methods in Language Learning Chapter 5 Validity in Experimental Research.
Chapter 8 – Lecture 6. Hypothesis Question Initial Idea (0ften Vague) Initial ObservationsSearch Existing Lit. Statement of the problem Operational definition.
SOCW 671: #6 Research Designs Review for 1 st Quiz.
Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 15: Single-Participant Experiments, Longitudinal Studies, and Quasi-Experimental.
EXPERIMENTAL DESIGNS. Categories Lab experiments –Experiments done in artificial or contrived environment Field experiments –Experiments done in natural.
Chapter 7 Causal Designs. Issues Addressed l conditions of causality l what is an experiment? l differences between a lab vs field experiment l two types.
Psychology 290 Lab #6 – Research Design Nov. 7-9 Descriptive Correlation Experimental Quasi-experimental.
School of Public Administration & Policy Dr. Kaifeng Yang 研究设计 : 实验研究的基本问题.
Research designs Research designs Quantitative Research Designs.
CHOOSING A RESEARCH DESIGN
Research Design in Psychology
EXPERIMENTAL RESEARCH
Experimental Research
Experiments Why would a double-blind experiment be used?
Chapter 8 Experimental Design The nature of an experimental design
Ron Sterr Kim Sims Heather Cruz aka “The Carpool”
Chapter 6 Research Validity.
Social Research Methods Experimental Research
RESEARCH METHODS Lecture 35
Experimental Design.
Experimental Design.
Chapter 6 Research Validity.
Internal Validity - The extent to which all explanations for changes in the DV between conditions have been eliminated -- other than the IV. ie(7a)
Research Methods for the Behavioral Sciences
Types of Designs: R: Random Assignment of subjects to groups
Reminder for next week CUELT Conference.
Presentation transcript:

Lecture 10 Psyc 300A

Types of Experiments Between-Subjects (or Between- Participants) Design –Different subjects are assigned to each level of the IV –Random assignment to conditions –Difference between random assignment and random sampling Within-Subjects (or Within-Participants, or Repeated Measures) Design –Same subjects in all levels of the IV

True vs Quasi-Experiments True experiments have IVs that can truly be manipulated Quasi experiments include quasi-experimental IVs that cannot be manipulated; uses naturally-occurring groups of participants (participant variables) –Participants cannot be randomly assigned to groups –Looks like an experiment, but can’t get at causation

Practice: Types of Experiments ITV study Pepsi Challenge experiment from HW4 A researcher is interested in whether listening to classical music improves spatial ability. She randomly assigns participants to either a classical music condition or a no-music condition. Participants serve in the music or no-music conditions, then are tested on their spatial ability.

Review: Properties of Studies Internal Validity –Extent to which observed relationships in a study (scores) reflect relationships between hypothetical variables. External Validity –Extent to which the results of a study can generalize to other people and settings outside the study

Threats to Internal Validity These are threats because each represents potential confounding Nonequivalent control group/Selection: Occurs when one group initially differs from another History: Events take place between measurements that are not related to IV Maturation: Participants change over time Testing: Effects of repeated measurement on same person

Threats to Internal Validity Regression to the mean: Arises when participants are selected based on extreme scores Instrumentation: Changes may occur in the measurement device over time (including human measuring devices) Mortality or attrition: Occurs when participants drop out differentially Diffusion of treatment: Occurs when participants tell others about a study

Practice: Threats to Validity Psychologists investigated the relation between playing action video games and the ability to monitor the visual environment. They recruited a group of male undergraduates who played action video games at least one hour a day, four days a week over the previous six months. A control group of non-video game players also participated. The researchers discovered that video game players were better at monitoring visual elements unrelated to the video game while playing. The researcher concluded that playing video games increases one’s capacity to pay attention to details in a visual environment.

Practice: Threats to Internal Validity You read in a health magazine about a study in which a new therapy technique for depression was examined. A group of depressed volunteers participated in the study lasting 9 months. There were 50 participants at the beginning of the study, all of whom received the new therapy technique, but only 29 completed. The researcher claimed that of those who completed the program, 85% improved.

Experimenter and Participant Effects Participant Effects –Participants are not passive –Participant reactivity: behavior changes when participants know they are watched (may respond with cooperation, antagonism, social desirability) –Respond to demand characteristics

Social Desirability The pressure that participants feel to respond as they think they should, not as they actually feel or believe. The acceptable or PC response

Demand Characteristics These are cues that come from the experimenter or the experimental situation that tell a participant about the purpose of the experiment Participants may be right or wrong in their guesses Participants may change their behavior (e.g., become more or less cooperative)

Experimenter Effects Experimenter bias occurs when the behavior of the experimenter in some way affects the results of the study –Experimenter expectancy effects –Experimenter attributes

Experimenter Expectancy Effects When experimenter’s knowledge or belief about participants cause participants to act different from normal May involve –Demand characteristics (leaking) –Interpretation of responses –Subtle, not purposeful bias

Experimenter Attributes When characteristics of experimenter affect participants Examples: Age, ethnicity, attractiveness, gender, extraversion, controlling May limit external validity

Controlling Participant and Experimenter Effects Deception Blind studies Automation

Threats to External Validity Generalizing to populations Generalizing from lab settings Review: Replication –Literal (exact) –Conceptual