Design Conditions & Variables Explicating Design Variables Kinds of “IVs” Identifying potential confounds Why control “on the average” is sufficient Characteristics.

Slides:



Advertisements
Similar presentations
Educational Research: Causal-Comparative Studies
Advertisements

Experimental and Quasi-Experimental Research
1 COMM 301: Empirical Research in Communication Lecture 10 Kwan M Lee.
Non-theoretical Research (Radical Behaviorism). 1)When you run into something interesting, drop everything and study it. 2) Apparatuses sometimes breakdown.
Experimental Design making causal inferences. Causal and Effect The IV precedes the DV in time The IV precedes the DV in time The IV and DV are correlated.
FUNDAMENTAL RESEARCH ISSUES © 2012 The McGraw-Hill Companies, Inc.
Correlation AND EXPERIMENTAL DESIGN
EXPERIMENTAL DESIGNS Criteria for Experiments
QUASI-EXPERIMENTS w Compare subjects in different conditions on a DV w Lacks one or more criteria for an experiment (cause, comparison, control) w Interpreted.
Quasi-Experimental Designs
Experimental Research Independent variable Dependent variable Causation.
RESEARCH DESIGN : 1. Kinds of support for making CAUSAL interpretations of observed relationships quality of theory research design used measurement procedures.
QUASI-EXPERIMENTS What is a Quasi-Experiment?
EXPERIMENTAL DESIGNS What Is Required for a True Experiment? What Are the Independent and Dependent Variables? What Is a Confounding Variable? What Are.
Studying Behavior. Midterm Review Session The TAs will conduct the review session on Wednesday, October 15 th. If you have questions, your TA and.
Prelude to Research Designs Review of a few things Demonstrations vs. Comparisons Experimental & Non-Experimental Designs “IVs” and “DVs” Between Group.
Review of Factorial Designs 5 terms necessary to understand factorial designs 5 patterns of factorial results for a 2x2 factorial designs Descriptive &
Design Conditions & Variables Limitations of 2-group designs “Kinds” of Treatment & Control conditions Kinds of Causal Hypotheses Explicating Design Variables.
2x2 BG Factorial Designs Definition and advantage of factorial research designs 5 terms necessary to understand factorial designs 5 patterns of factorial.
Prelude to Internal Validity Types Of the four types of validity (Measurement, External, Internal & Statistical Conclusion), we will be most concerned.
Experimental Group Designs
Internal Validity Measured & Manipulated Variables & Constants Causes, Effects, Controls & Confounds Components of Internal Validity “Creating” initial.
Methods to Control Extraneous Variables
Chapter 8 Experimental Research
Chapter 8 Experimental Design.
1 Psych 5500/6500 Confounding Variables Fall, 2008.
Chapter 3 The Research Design. Research Design A research design is a plan of action for executing a research project, specifying The theory to be tested.
Quantitative Research Designs
1 Basic Definitions Greg C Elvers, Ph.D.. 2 Statistics Statistics are a set of tools that help us to summarize large sets of data data -- set of systematic.
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
Chapter 8 Experimental Design: Dependent Groups and Mixed Groups Designs.
Design Experimental Control. Experimental control allows causal inference (IV caused observed change in DV) Experiment has internal validity when it fulfills.
Single-Factor Experimental Designs
Chapter 10 Experimental Research: One-Way Designs.
Types of validity we will study for the Next Exam... internal validity -- causal interpretability external validity -- generalizability statistical conclusion.
Experimental Design making causal inferences Richard Lambert, Ph.D.
Techniques of research control: -Extraneous variables (confounding) are: The variables which could have an unwanted effect on the dependent variable under.
COMM 250 Agenda - Week 10 Housekeeping C2 – Returned to You Today RP1 – Due Today (IM Surveys) TP3a – Due Tomorrow Lecture RAT4 Review RP1 Experiments.
Experimental Design: One-Way Correlated Samples Design
Understanding Hypothesis- your prediction Experimental Hypothesis- there will be a difference and here is what I think it will be and why (based on previous.
The What and the Why of Statistics The Research Process Asking a Research Question The Role of Theory Formulating the Hypotheses –Independent & Dependent.
Chapter 1: The What and the Why of Statistics  The Research Process  Asking a Research Question  The Role of Theory  Formulating the Hypotheses  Independent.
Experimental Design Experiment: A type of research study that tests the idea that one variable causes an effect on another variable.
STUDYING BEHAVIOR © 2009 The McGraw-Hill Companies, Inc.
Introduction section of article
The Psychologist as Detective, 4e by Smith/Davis © 2007 Pearson Education Chapter Six: The Basics of Experimentation I: Variables and Control Chapter Six:
Factorial Designs: Programmatic Research, RH: Testing & Causal Inference Applications of Factorial designs in Programmatic Research Research Hypotheses.
1.) *Experiment* 2.) Quasi-Experiment 3.) Correlation 4.) Naturalistic Observation 5.) Case Study 6.) Survey Research.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
METHODS IN BEHAVIORAL RESEARCH NINTH EDITION PAUL C. COZBY Copyright © 2007 The McGraw-Hill Companies, Inc.
Chapter 10 Experimental Research Gay, Mills, and Airasian 10th Edition
Chapter 10 Finding Relationships Among Variables: Non-Experimental Research.
Simple Experiments. Causal Claim Boldest claim a scientist can make Verbs such as “associated with” and “related to” replaced with “causes, influences,
Causal inference A cause must always be relative to another cause Wrong: –Eating an avocado before taking a test causes better performance on the test.
Research Methods and Data Analysis in Psychology Spring 2015 Kyle Stephenson.
Aim: What factors must we consider to make an experimental design?
Experimental Control. Part 1 Experimental Control.
Research Design. Descriptive (“what”) –No attempt to develop a hypothesis –Example: Where do guns used in crime come from? Explanatory (“why”) –Hypothesis.
Chapter 3. Research perspectives QuantitativeQualitative DescriptiveInferential True ExperimentalQuasi Experimental Causal ComparativeCorrelational Single.
Varieties of Research Designs 3x3 Structure for single-IV designs –(3) Design differences & causal interpretability –(3) Design differences & statistical.
Experimental Psychology PSY 433
2 independent Groups Graziano & Raulin (1997).
Designing an Experiment
Making Causal Inferences and Ruling out Rival Explanations
Pre-post Double Blind Placebo Control Group Design
The Experimental Method in Psychology
RESEARCH METHODS Lecture 33
Chapter 6 Research Validity.
Research Methods for the Behavioral Sciences
CHAPTER 8 EXPERIMENTAL DESIGN © 2012 The McGraw-Hill Companies, Inc.
Presentation transcript:

Design Conditions & Variables Explicating Design Variables Kinds of “IVs” Identifying potential confounds Why control “on the average” is sufficient Characteristics & varieties of design variables

Kinds of variables before & after a study Before a studyAfter the studyIVDV Potential Control Variables Confounds -- initial equiv. of subj vars -- ongoing equiv of proc vars Confound Variables -- subject var confounds -- procedural var confounds

Explicating Design Variables What I want you to be able to do is to tell the specific “function” of any variable in any study you read -- even if that variable is not mentioned in the description of the method & procedure ! We’ll start by reviewing basic elements of variables and functions Subject variables and procedural variables subject variables are things the value of which participants “bring with them” when they arrive at the study age, gender, personality characteristics, prior history, etc. Procedural variables are thing the value of which are “provided” or “created” by the researcher during the study

Kinds of “IVs” Manipulated IVs each subject’s value on the IV is determined (created, imbued, manipulated) by the researcher if properly done, provides temporal precedence and contributes to the ongoing equivalence of the study RA, self-selection or “administrative selection” can precede manipulation of an IV used in True and Quasi-Experiments Subject Variable “IVs” what IV condition the subject is in depends upon characteristic, attribute, or history of that subject be sure to distinguish this from self-selection of a manipulated IV used in Natural Groups Designs

About Potential Confounding Variables Like IVs, potential confounds are causal variables they are variables that we think (fear) could have a causal influence on a subject’s DV score if equivalent (on the average) across IV conditions, then they are “control variables “ and contribute to the casual interpretability of the results if nonequivalent (on the average) across IV conditions, they are “confounds” that introduce alternative explanations of why the mean DV scores differed across the IV conditions Candidates for Confounding Variables variables that researchers in your area have attempted to control (recognized confounds) variables know to be causal influences upon your DV (previously effective IVs) that are not the IV in your study

Why are initial and ongoing equivalence “on the average” sufficient for causal interpretation of the IV-DV relationship ?? When we make the causal IV-DV inference/interpretation, we do it based on … IV differences across the IV conditions mean differences on the DV across the IV conditions tells us there is a statistical IV-DV relationship no other differences across the IV conditions tells is the “only reasonable” source of the DV differences is the IV

Here’s another way of describing this... individual folks may differ on subject or procedural variables that influences their individual DV scores some folks in any condition will be higher and some lower on each of the potential confounds than folks in the other conditions -- creating higher or lower individual DV scores So, as long are there are no variables (confounds) that are different “on the average” across the IV conditions, then the “average DV differences” across the IV conditions are caused by the IV “on the average”

Explicating the “role” of variables in research designs any given variable must be … a manipulated variable or a subject variable a DV or an IV or a control variable or a confound a control variable has either been... balanced (usually by RA or matching) or held constant or eliminated a confounding variable is either a problem with initial equiv. (subject variable) or ongoing equivalence (procedural variable) Remember: all subject variables are controlled by RA (of individuals) all subject variables are confounds in QE or NG designs (except for any that were used in post hoc matching) with a priori matching - all subject variables are controlled with post hoc matching -- only matching variable(s) is controlled

manipulated subject independent dependent confound controlled "constant" eliminated balanced matched random assignment Always pick ONE of these two !!! Always pick ONE of these four !!! If you say the variable is a CONTROL variable, always pick one of these three types of control !!! If you say the variable was controlled by BALANCING, be sure to tell which balancing technique was used If you say the variable was a CONFOUND, tell if confound of initial or ongoing equivalence