Validity 4 For research to be considered valid, it must be based on fact or evidence; that is, it must be "capable of being justified."

Slides:

Advertisements

Similar presentations

PhD Research Seminar Series: Valid Research Designs

Advertisements

Action Research Not traditional educational research often research tests theory not practical Teacher research in classrooms and/or schools/districts.

Do you think Research in psychology is Important? Why or why not?

Increasing your confidence that you really found what you think you found. Reliability and Validity.

Research Methods Overview of quantitative and qualitative methods.

Measurement Validity and Reliability. Reliability: The degree to which measures are free from random error and therefore yield consistent results.

ALEC 604: Writing for Professional Publication Week 7: Methodology.

Introduction to Qualitative Research

Business research methods: data sources

Testing for Language Teachers

Formulating the research design

Descriptive and Causal Research Designs

Research Report Writing Presentation How to write a complete research report Part 3: Methodology.

The Vocabulary of Research. What is Credibility? A researcher’s ability to demonstrate that the study is accurate based on the way the study was conducted.

Research Process Research Process Step One – Conceptualize Objectives Step One – Conceptualize Objectives Step Two – Measure Objectives Step Two – Measure.

By Suwattana Sawatasuk. Marketing Research  The systematic design, collection, and analysis, and reporting of data relevant to a specific marketing situation.

Validity and Reliability

Overview of MSP Evaluation Rubric Gary Silverstein, Westat MSP Regional Conference San Francisco, February 13-15, 2008.

Research Process Step One – Conceptualization of Objectives Step Two – Measurement of Objectives Step Three – Determine Sampling Technique Step Four –

Group Discussion Explain the difference between assignment bias and selection bias. Which one is a threat to internal validity and which is a threat to.

 For the IB Diploma Programme psychology course, the experimental method is defined as requiring: 1. The manipulation of one independent variable while.

What research is Noun: The systematic investigation into and study of materials and sources in order to establish facts and reach new conclusions. Verb:

Assessment with Children Chapter 1. Overview of Assessment with Children Multiple Informants – Child, parents, other family, teachers – Necessary for.

Key steps in conducting survey research Decide if a survey is the best design to use Short time, economical, dispersed population, anonymity Report what.

CHAPTER III IMPLEMENTATIONANDPROCEDURES.  4-5 pages  Describes in detail how the study was conducted.  For a quantitative project, explain how you.

Evaluating a Research Report

Research Strategies Chapter 6. Research steps Literature Review identify a new idea for research, form a hypothesis and a prediction, Methodology define.

MODULE 3 INVESTIGATING HUMAN AND SOCIL DEVELOPMENT IN THE CARIBBEAN.

Systematic Review Module 7: Rating the Quality of Individual Studies Meera Viswanathan, PhD RTI-UNC EPC.

Is research in education important?. What is the difference between Qualitative and Quantitative Research Methods?

Wade/Tavris, (c) 2006, Prentice Hall How Psychologists Do Research Chapter 2.

Quantitative and Qualitative Approaches

Copyright 2000 Prentice Hall5-1 Chapter 5 Marketing Information and Research: Analyzing the Business Environment.

CDIS 5400 Dr Brenda Louw 2010 Validity Issues in Research Design.

NAME Evaluation Report Name of author(s) Name of institution Year.

TRUSTWORTHINESS OF THE RESEARCH Assoc. Prof. Dr. Şehnaz Şahinkarakaş.

Scientifically-Based Research What is scientifically-based research? How do evaluate it?

Why is Research Important?. Basic Research Pure science or research Research for the sake of finding new information and expanding the knowledge base.

Evaluating Impacts of MSP Grants Hilary Rhodes, PhD Ellen Bobronnikov February 22, 2010 Common Issues and Recommendations.

Reliability, Validity, and Bias. Reliability Reliability Reliability is the extent to which an experiment, test, or any measuring procedure yields the.

Copyright © Allyn & Bacon 2008 Intelligent Consumer Chapter 14 This multimedia product and its contents are protected under copyright law. The following.

Evaluating Impacts of MSP Grants Ellen Bobronnikov Hilary Rhodes January 11, 2010 Common Issues and Recommendations.

PRESENTATION TOPIC : RELIABILITY THEORY PRESENTED BY : ABDUL KHALIQ KHAN PRESENTED TO : SIR MUDASSIR FAROOQI SUBJECT : ADVANCE RESEARCH PROGRAM : MCOM.

Chapter 10 Experimental Research Gay, Mills, and Airasian 10th Edition

Anatomy of a Research Article Five (or six) major sections Abstract Introduction (without a heading!) Method (and procedures) Results Discussion and conclusions.

Ch 9 Internal and External Validity. Validity  The quality of the instruments used in the research study  Will the reader believe what they are readying.

Chapter Eight: Quantitative Methods

CHAPTER III AED 615 Fall 2006 Dr. Franklin. Chapter Overview Chapter III is your thesis or project “recipe”. You describe the steps you took to conduct.

Quantitative research Meeting 7. Research method is the most concrete and specific part of the proposal.

How Psychologists Do Research Chapter 2. How Psychologists Do Research What makes psychological research scientific? Research Methods Descriptive studies.

1 Conceptual Framework Research Questions Data Collection.

1 KULIAH 2B Survey Design PM Abdul Majid Ismail Ir.M Nawawiy Ir.Dwira.

STEPS IN RESEARCH PROCESS 1. Identification of Research Problems This involves Identifying existing problems in an area of study (e.g. Home Economics),

Issues in Evaluating Educational Research

Unit 8: Intelligence (Cognition)

Observational Study vs. Experimental Design

HRM – UNIT 10 Elspeth Woods 9 May 2013

Chapter 2 Sociological Research Methods

The Nature of Qualitative Research

Measurement Reliability and Validity

RELIABILITY AND VALIDITY AT ALL STAGES

Reliability & Validity.

Reliability, Validity, and Bias

Procedures & Collecting Data

Basic Concepts in Social Science Research

Chapter One Data Collection

Methods (1) Sample section: Describe the procedure for selecting units (such as subjects and records) for the study and ensure that it is appropriate.

Presentation transcript:

Validity 4 For research to be considered valid, it must be based on fact or evidence; that is, it must be "capable of being justified."

Types of Validity Internal validity is the extent to which results can be interpreted accurately. External validity is the extent to which results can be generalized to populations, situations, and conditions.

Internal Validity Requires: 4 random assignment of subjects to the test conditions. 4 the use of the same measurement instrument and procedures for all subjects.

Eample #1: Internal Validity School 1 Teacher A Blue Program Physical Performance Test B Administered by Teacher A Class 1 8th Grade Boys Random Assignment School 2 Teacher A Red Program Physical Performance Test B Administered by Teacher A Class 1 8th Grade Boys Random Assignment 16 Weeks of Program ImplementationTesting Period

External Validity Requires:  Random selection of subjects (or random assignment to study conditions).  The use of a single measurement instrument and procedure.

Example #2: External Validity Elementary School #1 15 Randomly Selected Teachers Elementary School #2 15 Randomly Selected Teachers Elementary School #3 15 Randomly Selected Teachers Elementary School #4 15 Randomly Selected Teachers Survey Conducted Results: All Teachers Schools 1-5

Reliability 4 Research is reliable to the extent that –(1) its components are consistent with one another (internal reliability) –(2) it can be replicated and yield similar outcomes (external reliability).

Internal Reliability 4 Good internal reliability is demonstrated by a consistent:  data collection procedure,  data analysis process, and  interpretation of the data.

Example #3: Internal Reliability Interviewer A Telephone Survey #1 28 randomly selected high school principals Interviewer B Telephone Survey #1 28 randomly selected high school principals Interviewer C Telephone Survey #1 28 randomly selected high school principals Interviewer D Telephone Survey #1 28 randomly selected high school principals

External Reliability 4 Good external reliability exists when a study is described in enough detail to facilitate its replication. 4 A research report, if a study is to be considered externally reliable, includes:  detailed description of the study's design  detailed description of the population, sample & sampling strategy  explanation of the data collection strategy(ies) & procedure(s)  detailed explanation of analysis procedures. 4 Bottom Line: Can the study be replicated?