Lecture 12 Psyc 300A. Review: Inferential Statistics We test our sample recognizing that differences we observe may be simply due to chance. Significance.

Slides:



Advertisements
Similar presentations
Questions What is the relationship between ‘research designs’ and ‘research strategies’? Which method of experiments, within subjects or between subjects.
Advertisements

Experimental and Quasi-Experimental Research
Control Any means used to rule out threats to validity Example –Hypothesis: Rats learned to press a bar when a light was turned on. –Data for 10 rats bar.
Winslow Homer: “On The Stile” INFERENTIAL PROBLEM SOLVING Hypothesis Testing and t-tests Chapter 6:
EXPERIMENTAL DESIGNS Criteria for Experiments
Business 205. Review Sampling Continuous Random Variables Central Limit Theorem Z-test.
Lecture 13 Psyc 300A. Review Confounding, extraneous variables Operational definitions Random sampling vs random assignment Internal validity Null hypothesis.
Statistics Sample: Descriptive Statistics Population: Inferential Statistics.
Using Statistics in Research Psych 231: Research Methods in Psychology.
Non-Experimental designs: Developmental designs & Small-N designs
Instructor: Vincent Duffy, Ph.D. Associate Professor Lecture 10: Research, Design & Evaluation Tues. Feb. 20, 2007 IE 486 Work Analysis & Design II.
Experimental Design: Between and Within factors Psych 231: Research Methods in Psychology.
EXPERIMENTAL DESIGNS What Is Required for a True Experiment? What Are the Independent and Dependent Variables? What Is a Confounding Variable? What Are.
Lecture 11 Psyc 300A. Null Hypothesis Testing Null hypothesis: the statistical hypothesis that there is no relationship between the variables you are.
Lecture 10 Psyc 300A. Types of Experiments Between-Subjects (or Between- Participants) Design –Different subjects are assigned to each level of the IV.
Non-Experimental designs: Developmental designs & Small-N designs
Using Between-Subjects and Within-Subjects Experimental Designs
Lecture 14 Psyc 300A. Review Operational definitions Internal validity Threats to internal validity Type I and type II errors.
Design and Control in Experimental Research Lawrence R. Gordon Psychology Research Methods I.
Experimental Designs Psych 231: Research Methods in Psychology.
Experimental Design: Between and Within factors Psych 231: Research Methods in Psychology.
Experimental Psychology PSY 433 Chapter 3 Experiments -- Designs.
S519: Evaluation of Information Systems Social Statistics Inferential Statistics Chapter 8: Significantly significant.
Experimental Design: Between and within factors Psych 231: Research Methods in Psychology.
Using Statistics in Research Psych 231: Research Methods in Psychology.
Methods to Control Extraneous Variables
Descriptive Statistics
Introduction to Testing a Hypothesis Testing a treatment Descriptive statistics cannot determine if differences are due to chance. A sampling error occurs.
Copyright c 2001 The McGraw-Hill Companies, Inc.1 Chapter 7 Sampling, Significance Levels, and Hypothesis Testing Three scientific traditions critical.
Choosing Statistical Procedures
+ Quantitative Statistics: Chi-Square ScWk 242 – Session 7 Slides.
PSYC2030 Exam Review #2 March 13th 2014.
Chapter 4 Hypothesis Testing, Power, and Control: A Review of the Basics.
 The “4 Steps” of Hypothesis Testing: 1. State the hypothesis 2. Set decision criteria 3. Collect data and compute sample statistic 4. Make a decision.
Chapter 8 Introduction to Hypothesis Testing
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
Matched Pairs, Within-Subjects, and Mixed Designs
Elementary Statistical Methods André L. Souza, Ph.D. The University of Alabama Lecture 22 Statistical Power.
Chapter 8 Experimental Design: Dependent Groups and Mixed Groups Designs.
Statistics and Research methods Wiskunde voor HMI Bijeenkomst 3 Relating statistics and experimental design.
Chapter 10 Experimental Research: One-Way Designs.
Components of a causal relationship Does a change in X cause a change in Y? There are 3 components: 1) Co ‑ variation of events 2) Time ‑ order relationship.
Control in Experimentation & Achieving Constancy Chapters 7 & 8.
Experimental Design: One-Way Correlated Samples Design
Step 3 of the Data Analysis Plan Confirm what the data reveal: Inferential statistics All this information is in Chapters 11 & 12 of text.
Statistics (cont.) Psych 231: Research Methods in Psychology.
Inference and Inferential Statistics Methods of Educational Research EDU 660.
Chapter 12 A Primer for Inferential Statistics What Does Statistically Significant Mean? It’s the probability that an observed difference or association.
Experimental Design Experiment: A type of research study that tests the idea that one variable causes an effect on another variable.
Why is Research Important?. Basic Research Pure science or research Research for the sake of finding new information and expanding the knowledge base.
Inferential Statistics Body of statistical computations relevant to making inferences from findings based on sample observations to some larger population.
Introduction section of article
Experimental Psychology PSY 433 Appendix B Statistics.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
CHAPTER 6 Control Problems in Experimental Research.
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 7 Sampling, Significance Levels, and Hypothesis Testing Three scientific traditions.
Finishing up: Statistics & Developmental designs Psych 231: Research Methods in Psychology.
1.  What inferential statistics does best is allow decisions to be made about populations based on the information about samples.  One of the most useful.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
BHS Methods in Behavioral Sciences I May 9, 2003 Chapter 6 and 7 (Ray) Control: The Keystone of the Experimental Method.
Statistics (cont.) Psych 231: Research Methods in Psychology.
Inferential Statistics Psych 231: Research Methods in Psychology.
PS Research Methods I with Kimberly Maring Unit 9 – Experimental Research Chapter 6 of our text: Zechmeister, J. S., Zechmeister, E. B., & Shaughnessy,
7 Control Techniques in Experimental Research.
Chapter 8: Hypothesis Testing and Inferential Statistics
Experimental Design.
Experimental Design.
Scientific Method Steps
Inferential Statistics (Part IV)
Rest of lecture 4 (Chapter 5: pg ) Statistical Inferences
Presentation transcript:

Lecture 12 Psyc 300A

Review: Inferential Statistics We test our sample recognizing that differences we observe may be simply due to chance. Significance level (alpha) is the risk we are willing to assume that we will say there is a relationship between variables when in fact there isn’t (it’s due to chance).

Review: Type I and Type II Errors Accept the Null Hypothesis Reject the Null Hypothesis Null is really True Correct Decision Type I Error Null is really False Type II Error Correct Decision

Review: t-test SPSS Output

Experimenter and Participant Effects Participant Effects –Participants are not passive –Participant reactivity: behavior changes when participants know they are watched (may respond with cooperation, antagonism, social desirability) –Respond to demand characteristics

Social Desirability The pressure that participants feel to respond as they think they should, not as they actually feel or believe. The acceptable or PC response

Demand Characteristics These are cues that come from the experimenter or the experimental situation that tell a participant about the purpose of the experiment Participants may be right or wrong in their guesses Participants may change their behavior (e.g., become more or less cooperative)

Experimenter Effects Experimenter bias occurs when the behavior of the experimenter in some way affects the results of the study –Experimenter expectancy effects –Experimenter attributes

Experimenter Expectancy Effects When experimenter’s knowledge or belief about participants cause participants to act different from normal May involve –Demand characteristics (leaking) –Interpretation of responses –Subtle differences in behavior toward participants

Experimenter Attributes When characteristics of experimenter affect participants Examples: Age, ethnicity, attractiveness, gender, extraversion, controlling May limit external validity

Controlling Participant and Experimenter Effects Deception Blind studies Automation

Threats to External Validity Generalizing to populations Generalizing from lab settings Review: Replication –Literal (exact) –Conceptual

Review: Types of Experiments Between-Subjects (or Between- Participants) Design –Different subjects are assigned to each level of the IV –Random assignment to conditions –Difference between random assignment and random sampling Within-Subjects (or Within-Participants, or Repeated Measures) Design –Same subjects in all levels of the IV

Within-Subjects Designs Advantages –Participants serve as own controls Groups are equivalent at beginning Reduced variability among participants –Need fewer participants –More powerful (more likely to detect relationships when present) Limitations –Order effects –Can’t use when participant variables are IV –Sometimes long time lags (esp. longitudinal designs)

Order Effects and Counterbalancing Order Effects –Practice effects –Fatigue effects –Carryover effects Counterbalancing –Example: A-B-C –Complete –Partial

Matched-Participants Design Match participants on an important variable Different participants in different conditions (like between), but analyzed like a within- subjects Advantages: reduce demand characteristics, eliminate order effects, reduce variability Disadvantages: Finding matches, only matches for some characteristics

Developmental Designs Cross-sectional design –Between subjects design –Cohort effect Longitudinal design –Within subjects design Sequential design –Mix of cross-sectional and longitudinal