Lecture 13 Psyc 300A. Review Confounding, extraneous variables Operational definitions Random sampling vs random assignment Internal validity Null hypothesis.

Slides:



Advertisements
Similar presentations
Power of a test. power The power of a test (against a specific alternative value) Is a tests ability to detect a false hypothesis Is the probability that.
Advertisements

Understanding the Variability of Your Data: Dependent Variable.
Significance and probability Type I and II errors Practical Psychology 1 Week 10.
Chapter 11: Sequential Clinical Trials Descriptive Exploratory Experimental Describe Find Cause Populations Relationships and Effect Sequential Clinical.
Instructor: Vincent Duffy, Ph.D. Associate Professor Lecture 10: Research, Design & Evaluation Tues. Feb. 20, 2007 IE 486 Work Analysis & Design II.
Power and Effect Size.
Lecture 11 Psyc 300A. Null Hypothesis Testing Null hypothesis: the statistical hypothesis that there is no relationship between the variables you are.
Review session II PSYC 217 Nov 28, 2008 Conny Lin.
Lecture 14 Psyc 300A. Review Operational definitions Internal validity Threats to internal validity Type I and type II errors.
Lecture 16 Psyc 300A. What a Factorial Design Tells You Main effect: The effect of an IV on the DV, ignoring all other factors in the study. (Compare.
Single Factor Experimental Designs I Lawrence R. Gordon Psychology Research Methods I.
Chapters 8 & 9 Advanced Experimental Design. Experimental Designs Between-subject designs  Simple randomized design  Multilevel randomized design Factorial.
Lecture 12 Psyc 300A. Review: Inferential Statistics We test our sample recognizing that differences we observe may be simply due to chance. Significance.
Lecture 15 Psyc 300A. Example: Movie Preferences MenWomenMean Romantic364.5 Action745.5 Mean55.
Ch12(1)1 Chapter 9 Procedure for Conducting an Experiment.
Factorial Experiments Factorial Design = experiment in which more than one IV (factor) at a time is manipulated Uses all possible combinations of the levels.
Analysis of Covariance The function of Experimental design is to explain the effect of a IV or DV while controlling for the confounding effect of extraneous.
Power of a Test Notes: P 183 and on your own paper.
Descriptive Statistics
Copyright c 2001 The McGraw-Hill Companies, Inc.1 Chapter 7 Sampling, Significance Levels, and Hypothesis Testing Three scientific traditions critical.
Inferential Statistics
Choosing Statistical Procedures
Chapter 4 Hypothesis Testing, Power, and Control: A Review of the Basics.
Basic Statistics Michael Hylin. Scientific Method Start w/ a question Gather information and resources (observe) Form hypothesis Perform experiment and.
Hypothesis Testing.
Hypothesis testing Dr David Field
Chapter 8 Introduction to Hypothesis Testing
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
Elementary Statistical Methods André L. Souza, Ph.D. The University of Alabama Lecture 22 Statistical Power.
Chapter 8 Experimental Design: Dependent Groups and Mixed Groups Designs.
Understanding the Variability of Your Data: Dependent Variable Two "Sources" of Variability in DV (Response Variable) –Independent (Predictor/Explanatory)
Types of validity we will study for the Next Exam... internal validity -- causal interpretability external validity -- generalizability statistical conclusion.
Chapter 7 Experimental Design: Independent Groups Design.
Experimental Design: One-Way Correlated Samples Design
Step 3 of the Data Analysis Plan Confirm what the data reveal: Inferential statistics All this information is in Chapters 11 & 12 of text.
Inference and Inferential Statistics Methods of Educational Research EDU 660.
Inferential Statistics Body of statistical computations relevant to making inferences from findings based on sample observations to some larger population.
Educational Research Chapter 13 Inferential Statistics Gay, Mills, and Airasian 10 th Edition.
Experimental Design Showing Cause & Effect Relationships.
Sampling and Probability Chapter 5. Sampling & Elections >Problems with predicting elections: Sample sizes are too small Samples are biased (also tied.
Introduction section of article
Power of a Hypothesis test. H 0 True H 0 False Reject Fail to reject Type I Correct Type II Power   Suppose H 0 is true – what if we decide to fail.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
But! Let’s first review…
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 7 Sampling, Significance Levels, and Hypothesis Testing Three scientific traditions.
Aim: What factors must we consider to make an experimental design?
Univariate Statistics PSYC*6060 Class 2 Peter Hausdorf University of Guelph.
Chapter 13 Understanding research results: statistical inference.
Hypothesis Testing Steps for the Rejection Region Method State H 1 and State H 0 State the Test Statistic and its sampling distribution (normal or t) Determine.
BHS Methods in Behavioral Sciences I May 9, 2003 Chapter 6 and 7 (Ray) Control: The Keystone of the Experimental Method.
Experimental Design. How To Design A Psychology Experiment  Start with a research question  It must be testable – you must be able to change one variable.
Psychological Experimentation The Experimental Method: Discovering the Causes of Behavior Experiment: A controlled situation in which the researcher.
Some Terminology experiment vs. correlational study IV vs. DV descriptive vs. inferential statistics sample vs. population statistic vs. parameter H 0.
8 Experimental Research Design.
Experiment Basics: Designs
Power and Multiple Regression
Power of a test.
Chapter 8: Hypothesis Testing and Inferential Statistics
Hypothesis Testing: Hypotheses
Hypothesis Expresses a relationship between two variables.
Chapter 6 Making Sense of Statistical Significance: Decision Errors, Effect Size and Statistical Power Part 1: Sept. 18, 2014.
Experiment Basics: Designs
Design Considerations: Independent Samples v. Repeated Measures
Chapter 3 Probability Sampling Theory Hypothesis Testing.
Power.
Chapter 12 Power Analysis.
Chapter 7: Statistical Issues in Research planning and Evaluation
Power of a test.
Statistical Power.
Rest of lecture 4 (Chapter 5: pg ) Statistical Inferences
Presentation transcript:

Lecture 13 Psyc 300A

Review Confounding, extraneous variables Operational definitions Random sampling vs random assignment Internal validity Null hypothesis Type I and type II errors

Review: Confounding and extraneous variables Extraneous variables can be confounds, but can also add variability (noise). For each, provide extraneous variable and confound: Study 1: Effect of distraction on pain perception using cold immersion. Study 2: Do girls benefit from sixth grade middle school?

Review: Operational definitions For each of the previous studies, operationalize the IV and DV

Review: Random sampling vs random assignment What is the difference between the two? Random assignment is a way to prevent confounding

Review: Internal validity What is internal validity? Internal validity: Ability to make valid inferences concerning the relationship between the IV and DV in an experiment. (effect on the DV is caused only by the IV)

Type I and Type II Errors Accept the Null Hypothesis Reject the Null Hypothesis Null is really True (chance is responsible) Correct Decision Type I Error Null is really False (chance is not responsible) Type II Error Correct Decision

Power Power is the probability of avoiding a Type II error. Power is related to: –Alpha level –Effect size (mean and sd) –Number of participants

Using More Than Two Levels of an IV What is a level of an IV? In an experiment with an experimental and control group, how many levels? Can we have more than two levels? Example: –Golf club study –Anxiety management techniques for speech-giving Graphing the relationship

Advantages of Multi-level Designs Efficiency (fewer participants needed and less time) Ability to see relationships better –Ex: Caffeine and Performance (0, 2, 4 cups of coffee)

Graphing Relationships: One IV

Multifactor Designs Factorial design: A design in which all levels of each IV are combined with all levels of the other IVs. Advantages of factorial designs: –More efficient (fewer participants and less experimenter time) –Allows us to see how variables interact

Example: Movie Preferences MenWomenMean Romantic364.5 Action745.5 Mean55

What a Factorial Design Tells You Main effect: The effect of an IV on the DV, ignoring all other factors in the study Interaction effect: When the effect of one IV on a DV differs depending on the level of a second IV. Graphing a factorial design Interpreting the interaction first

Examples of Main Effects and Interactions A1= morning A2= late afternoon B1= high fat diet B2= low fat diet DV: 0-50 rating of energy level

More Main Effects and Interactions A1= morning A2= late afternoon B1= high fat diet B2= low fat diet DV: 0-50 rating of energy level

More Main Effects and Interactions A1= morning A2= late afternoon B1= high fat diet B2= low fat diet DV: 0-50 rating of energy level

Group Activity: Main Effects and Interactions Make graphs of the following situations: Var AVar BAxB interaction p <.05 n.s. p <.05 n.s.p <.05 n.s. p <.05

Factorial Designs: Naming Conventions The first number is the number of levels in first IV, second number is number of levels in second IV, etc. 2 x 2 2 x 3 2 x 2 x 3 Between-subjects, repeated measures (within), mixed

A 2 x 3 Interaction