Advanced Research Methods Unit 3 Reliability and Validity.

Slides:



Advertisements
Similar presentations
The Research Consumer Evaluates Measurement Reliability and Validity
Advertisements

Taking Stock Of Measurement. Basics Of Measurement Measurement: Assignment of number to objects or events according to specific rules. Conceptual variables:
1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.
Psychlotron.org.uk Why is it important that psychological research be valid and reliable?
MEASUREMENT CONCEPTS © 2012 The McGraw-Hill Companies, Inc.
© 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Validity and Reliability Chapter Eight.
Start your learning and revising now J Griffiths for NGfL Cymru.
Psychometrics William P. Wattles, Ph.D. Francis Marion University.
VALIDITY AND RELIABILITY
Defining, Measuring and Manipulating Variables. Operational Definition  The activities of the researcher in measuring and manipulating a variable. 
Part II Sigma Freud & Descriptive Statistics
RESEARCH METHODS Lecture 18
RELIABILITY & VALIDITY What is Reliability? What is Reliability?What is Reliability?What is Reliability? How Can We Measure Reliability? How Can We Measure.
Reliability and Validity Dr. Roy Cole Department of Geography and Planning GVSU.
RELIABILITY & VALIDITY
MEASUREMENT the process of determining the value or level of a particular CONSTRUCT for every unit of analysis or subject involves OPERATIONALIZATION –translating.
Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.
BASIC TERMINOLOGY n Test n Measurement n Evaluation.
PSYC512: Research Methods PSYC512: Research Methods Lecture 5 Brian P. Dyre University of Idaho.
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 5 Making Systematic Observations.
SOWK 6003 Social Work Research Week 5 Measurement By Dr. Paul Wong.
PSYC512: Research Methods PSYC512: Research Methods Lecture 6 Brian P. Dyre University of Idaho.
FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,
Chapter 5 Measuring Variables. DESCRIBING VARIABLES Correspondence Standardization Quantification Duplication.
Classroom Assessment A Practical Guide for Educators by Craig A
Work in the 21st Century Chapter 2
Instrumentation.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
Psychometrics William P. Wattles, Ph.D. Francis Marion University.
Principles of Test Construction
Southern Methodist UniversityPSYC Observation Chapter 4.
WELNS 670: Wellness Research Design Chapter 5: Planning Your Research Design.
Instrumentation (cont.) February 28 Note: Measurement Plan Due Next Week.
Psychology 290 Lab #2 Sept. 26 – 28 Types & Parts of Articles Operational Definition Variables Reliability & Validity.
Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.
Counseling Research: Quantitative, Qualitative, and Mixed Methods, 1e © 2010 Pearson Education, Inc. All rights reserved. Basic Statistical Concepts Sang.
EDU 8603 Day 6. What do the following numbers mean?
Reliability vs. Validity.  Reliability  the consistency of your measurement, or the degree to which an instrument measures the same way each time it.
Chapter 4 – Research Methods in Clinical Psych Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.
Validity Validity: A generic term used to define the degree to which the test measures what it claims to measure.
Evaluating Survey Items and Scales Bonnie L. Halpern-Felsher, Ph.D. Professor University of California, San Francisco.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
Reliability: The degree to which a measurement can be successfully repeated.
PRESENTATION TOPIC : RELIABILITY THEORY PRESENTED BY : ABDUL KHALIQ KHAN PRESENTED TO : SIR MUDASSIR FAROOQI SUBJECT : ADVANCE RESEARCH PROGRAM : MCOM.
MEASUREMENT: PART 1. Overview  Background  Scales of Measurement  Reliability  Validity (next time)
7/13/03Copyright Ed Lipinski and Mesa Community College, All rights reserved. 1 Research Methods Summer 2009 Using Survey Research.
Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.
DENT 514: Research Methods
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Chapter 6 - Standardized Measurement and Assessment
Reliability a measure is reliable if it gives the same information every time it is used. reliability is assessed by a number – typically a correlation.
Validity & Reliability. OBJECTIVES Define validity and reliability Understand the purpose for needing valid and reliable measures Know the most utilized.
Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
WHS AP Psychology Unit 7: Intelligence (Cognition) Essential Task 7-3:Explain how psychologists design tests, including standardization strategies and.
Measurement and Scaling Concepts
Consistency and Meaningfulness Ensuring all efforts have been made to establish the internal validity of an experiment is an important task, but it is.
VALIDITY What is validity? What are the types of validity? How do you assess validity? How do you improve validity?
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Ch. 5 Measurement Concepts.
Reliability and Validity in Research
Tests and Measurements: Reliability
Reliability and Validity
Reliability and Validity
پرسشنامه کارگاه.
Reliability.
Measurement Concepts and scale evaluation
Presentation transcript:

Advanced Research Methods Unit 3 Reliability and Validity

Reliability Ability to produce similar results when repeated measurements are made under identical conditions. Inter-rater reliability Test-retest reliability Parallel-forms reliability Split-half reliability

Reliability Interrater – ratings of multiple observers Test-retest – administering the same test twice, separated by time Parallel-forms – parallel forms of test administered Split-half – responses separated into two halves

Validity Extent to which a measure assesses what it is intended to measure. Face validity – how well a measure appears to measure the intended variable Content validity – how well a measure samples intended content

Validity Construct validity Measure of a psychological variable Criterion-related validity Concurrent validity – test scores and score on criterion are collects at same time Predictive validity – test scores compared with a criterion measured at a later date

Qualitative vs. Quantitative Qualitative Researchers provide a verbal summary of observations Researchers code observations to identify themes, categorize information, and record observations

Qualitative vs. Quantitative Quantitative Provides a numerical summary of the observations. Calculates descriptive statistics (mean, mode, median).

Types of Dependent Variables Behavioral measures – record behaviors Physiological measures – assessment of bodily functions (heart rate, respiration, etc.) Self-report measures – rating scales Implicit measures – assessments participant is not consciously aware of

Discussion