Introduction to Validity True Experiment – searching for causality What effect does the I.V. have on the D.V. Correlation Design – searching for an association.

Slides:

Advertisements

Similar presentations

Experimental Design.

Advertisements

Agenda Group Hypotheses Validity of Inferences from Research Inferences and Errors Types of Validity Threats to Validity.

Questions What is the relationship between ‘research designs’ and ‘research strategies’? Which method of experiments, within subjects or between subjects.

Validity (cont.)/Control RMS – October 7. Validity Experimental validity – the soundness of the experimental design – Not the same as measurement validity.

Experimental Design Internal Validation Experimental Design I. Definition of Experimental Design II. Simple Experimental Design III. Complex Experimental.

Experimental Design and the struggle to control threats to validity.

Experimental and Quasi-Experimental Research

Copyright © Allyn & Bacon (2007) Hypothesis Testing, Validity, and Threats to Validity Graziano and Raulin Research Methods: Chapter 8 This multimedia.

Validity of Quantitative Research Conclusions. Internal Validity External Validity Issues of Cause and Effect Issues of Generalizability Validity of Quantitative.

Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 4: An Overview of Empirical Methods 1.

Validity Validity of measurement Validity of research

Reliability and Validity in Experimental Research ♣

MSc Applied Psychology PYM403 Research Methods Validity and Reliability in Research.

Sampling and Experimental Control Goals of clinical research is to make generalizations beyond the individual studied to others with similar conditions.

Psychology 242 Research Methods II Dr. David Allbritton

Validity Lecture Overview Overview of the concept Different types of validity Threats to validity and strategies for handling them Examples of validity.

EVALUATING YOUR RESEARCH DESIGN EDRS 5305 EDUCATIONAL RESEARCH & STATISTICS.

Inferential Statistics

Chapter 8 Experimental Research

Experimental Design The Gold Standard?.

Descriptive and Causal Research Designs

Chapter 2: The Research Enterprise in Psychology

Chapter 5 Research Methods in the Study of Abnormal Behavior Ch 5.

Chapter 2: The Research Enterprise in Psychology

Chapter 4 Hypothesis Testing, Power, and Control: A Review of the Basics.

Applying Science Towards Understanding Behavior in Organizations Chapters 2 & 3.

Day 6: Non-Experimental & Experimental Design

Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.

Epidemiology The Basics Only… Adapted with permission from a class presentation developed by Dr. Charles Lynch – University of Iowa, Iowa City.

I/O Psychology Research Methods. What is Science? Science: Approach that involves the understanding, prediction, and control of some phenomenon of interest.

Chapter 1: The Research Enterprise in Psychology.

Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.

Techniques of research control: -Extraneous variables (confounding) are: The variables which could have an unwanted effect on the dependent variable under.

Group Quantitative Designs First, let us consider how one chooses a design. There is no easy formula for choice of design. The choice of a design should.

Experimental Design: One-Way Correlated Samples Design

URBDP 491 A Lecture 7: Research Approaches Objectives How to compare alternative approaches Experimental vs. non-experimental approaches Cross-sectional.

Understanding Research Design Can have confusing terms Research Methodology The entire process from question to analysis Research Design Clearly defined.

Independent vs Dependent Variables PRESUMED CAUSE REFERRED TO AS INDEPENDENT VARIABLE (SMOKING). PRESUMED EFFECT IS DEPENDENT VARIABLE (LUNG CANCER). SEEK.

© 2000 John Wiley & Sons, Inc. Davison and Neale: Abnormal Psychology, 8e Abnormal Psychology, Eighth Edition by Gerald C. Davison and John M. Neale Lecture.

Validity RMS – May 28, Measurement Reliability The extent to which a measurement gives results that are consistent.

CDIS 5400 Dr Brenda Louw 2010 Validity Issues in Research Design.

Experimental Design Experiment: A type of research study that tests the idea that one variable causes an effect on another variable.

An Introduction to Statistics and Research Design

Review of Research Methods. Overview of the Research Process I. Develop a research question II. Develop a hypothesis III. Choose a research design IV.

1 Statistics in Research & Things to Consider for Your Proposal May 2, 2007.

Introduction section of article

Quantitative Research SPED 500 Dr. Sandra Beyda Designs that maximize objectivity by using numbers, statistics, structure, and experimenter control Modes.

The research process Psych 231: Research Methods in Psychology.

 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.

Chapter 6 Research Validity. Research Validity: Truthfulness of inferences made from a research study.

Chapter 10 Experimental Research Gay, Mills, and Airasian 10th Edition

Chapter 8 – Lecture 6. Hypothesis Question Initial Idea (0ften Vague) Initial ObservationsSearch Existing Lit. Statement of the problem Operational definition.

Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 15: Single-Participant Experiments, Longitudinal Studies, and Quasi-Experimental.

The research process Psych 231: Research Methods in Psychology.

Experimental Research Neuman and Robson, Ch. 9. Introduction Experiments are part of the traditional science model Involve taking “action” and observing.

Some Terminology experiment vs. correlational study IV vs. DV descriptive vs. inferential statistics sample vs. population statistic vs. parameter H 0.

Experimental and Quasi-Experimental Research

CHOOSING A RESEARCH DESIGN

Experiments Why would a double-blind experiment be used?

Hypothesis Testing, Validity, and Threats to Validity

Understanding Results

Experiments: Part 3.

Experiments and Quasi-Experiments

Hypothesis Testing, Validity &

Experiments and Quasi-Experiments

Experiments: Part 2.

Experiments: Part 3.

Experiments: Part 3.

Research Methods & Statistics

CS 594: Empirical Methods in HCC Experimental Research in HCI (Part 1)

Presentation transcript:

Introduction to Validity True Experiment – searching for causality What effect does the I.V. have on the D.V. Correlation Design – searching for an association between variables No causation, but often very accurate predictors of results

Introduction to Validity What is validity? Are the ideas that are being investigated the same ideas that are being measured? How appropriate or sound is the methodology that is being employed?

Overview of Today’s Lecture Topics: Statistical Validity Construct Validity External Validity Internal Validity

Statistical Validity Are the results of the data due to a systematic factor (I.V.) or are the results due to chance? Appropriate statistical test (Chi-square, t-test, ANOVA) A common threat to statistical validity is the violation of 1 or more assumptions of the test

Statistical Validity P – value and the null hypothesis Psychology and the.05 Alpha shelf Significance vs. Meaningfulness The final question of statistical validity- How accurate are the results of a statistical test?

Construct Validity Research hypotheses must have a theoretical basis Construct validity is concerned with how results support the underlying theory Is the theory that is supported the best theoretical explanation?

Construct Validity Steps to help maintain construct validity: 1.Operationally define variables with clear definitions 2.Develop hypotheses that are based upon strong, well supported theories

External Validity Generalizability of findings to other: Participants Subjects Places Times Environmental Conditions

External Validity To generalize from one sample to a population requires appropriate representation of the population Random selection from a population of interest helps in controlling for possible confounds

External Validity Ecological Validity – Properly generalizing from the laboratory to the “real world”

Internal Validity Is the I.V. responsible for the observable changes that occur in the D.V. Any factor (variable) that varies with the I.V. is a confound

Internal Validity Nine primary confounding variables: 1.Maturation (normal age change) 2.History (9/11) unrelated events 3.Testing (test-retest) 4.Instrumentation (alteration in calibration) 5.Regression to the mean

Internal Validity 6. Selection (non-equivalent groups) 7. Attrition (those who drop-out are likely different from the remaining) 8. Diffusion of treatment (talk among participants) 9. Sequence effects (experience during one part of the study influencing another part of the study)

Conclusion Validity concerns accuracy: Are our statistical results accurate? Are we using an accurate theoretical basis? Are we accurate in implying that our results can be generalized to a population? Are we measuring what we say that we are measuring?