Other Measurement Validity Types. OverviewOverview l Face validity l Content validity l Criterion-related validity l Predictive validity l Concurrent.

Slides:



Advertisements
Similar presentations
Agenda Levels of measurement Measurement reliability Measurement validity Some examples Need for Cognition Horn-honking.
Advertisements

Chapter 8 Flashcards.
Reliability And Validity
Using statistics in small-scale language education research Jean Turner © Taylor & Francis 2014.
Reliability, Validity, Trustworthiness If a research says it must be right, then it must be right,… right??
Chapter 4 Validity.
Test Validity: What it is, and why we care.
RELIABILITY & VALIDITY What is Reliability? What is Reliability?What is Reliability?What is Reliability? How Can We Measure Reliability? How Can We Measure.
On Theories, Hypotheses, Variables, Validity, and Reliability.
RELIABILITY & VALIDITY
Measurement Concepts. CONSTRUCT VALIDITY OF MEASURES Indicators of Construct Validity Face validity Aggression questionnaire Not enough to really determine.
Validity Does test measure what it says it does? Is the test useful? Can a test be reliable, but not valid? Can a test be valid, but not reliable?
Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.
Characteristics of Sound Tests
SELECTION & ASSESSMENT SESSION THREE: MEASURING THE EFFECTIVENESS OF SELECTION METHODS.
Validity of Selection. Objectives Define Validity Relation between Reliability and Validity Types of Validity Strategies.
The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What.
Validity and Reliability EAF 410 July 9, Validity b Degree to which evidence supports inferences made b Appropriate b Meaningful b Useful.
Chapter 7 Evaluating What a Test Really Measures
Reliability and Validity. Criteria of Measurement Quality How do we judge the relative success (or failure) in measuring various concepts? How do we judge.
Construct Validity and Measurement
Validity Lecture Overview Overview of the concept Different types of validity Threats to validity and strategies for handling them Examples of validity.
Construct Validity By Michael Kotutwa Johnson Submitted October 23, 2006 AED 615 Professor Franklin.
Validity and Validation: An introduction Note: I have included explanatory notes for each slide. To access these, you will probably have to save the file.
Test Validity S-005. Validity of measurement Reliability refers to consistency –Are we getting something stable over time? –Internally consistent? Validity.
VALIDITY. Validity is an important characteristic of a scientific instrument. The term validity denotes the scientific utility of a measuring instrument,
Measurement and Data Quality
Ch 6 Validity of Instrument
Instrument Validity & Reliability. Why do we use instruments? Reliance upon our senses for empirical evidence Senses are unreliable Senses are imprecise.
Instrumentation.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
Validity & Practicality
Lecture 6: Reliability and validity of scales (cont) 1. In relation to scales, define the following terms: - Content validity - Criterion validity (concurrent.
Validity. Face Validity  The extent to which items on a test appear to be meaningful and relevant to the construct being measured.
Validity Is the Test Appropriate, Useful, and Meaningful?
Measurement Validity.
Advanced Research Methods Unit 3 Reliability and Validity.
Chapter 8 Validity and Reliability. Validity How well can you defend the measure? –Face V –Content V –Criterion-related V –Construct V.
Concurrent Validity Pages By: Davida R. Molina October 23, 2006.
Session 4 Reliability and Validity. Validity What does the instrument measure and How well does it measure what it is supposed to measure? Is there enough.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Chapter 4 Validity Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006.
The Theory of Sampling and Measurement. Sampling First step in implementing any research design is to create a sample. First step in implementing any.
Testing, Measurement & Assessment Unit 5 Seminar - Validity.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
Reliability: The degree to which a measurement can be successfully repeated.
MEASUREMENT. MeasurementThe assignment of numbers to observed phenomena according to certain rules. Rules of CorrespondenceDefines measurement in a given.
Validity and Item Analysis Chapter 4. Validity Concerns what the instrument measures and how well it does that task Not something an instrument has or.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
 A test is said to be valid if it measures accurately what it is supposed to measure and nothing else.  For Example; “Is photography an art or a science?
Chapter 6 - Standardized Measurement and Assessment
Likert Scaling. Work quickly and effectively under pressure 49 Organize the work when directions are not specific. 39 Decide how to manage multiple tasks.
Survey Design Class 02.  It is a true measure  Measurement Validity is the degree of fit between a construct and indicators of it.  It refers to how.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
Consistency and Meaningfulness Ensuring all efforts have been made to establish the internal validity of an experiment is an important task, but it is.
Criminal Justice and Criminology Research Methods, Second Edition Kraska / Neuman © 2012 by Pearson Higher Education, Inc Upper Saddle River, New Jersey.
Reliability and Validity
Chapter 2 Theoretical statement:
Reliability and Validity
Questions What are the sources of error in measurement?
Concept of Test Validity
Social Research Methods MAN-10 Erlan Bakiev, Ph. D.
Test Validity.
Tests and Measurements: Reliability
Journalism 614: Reliability and Validity
Human Resource Management By Dr. Debashish Sengupta
PSY 614 Instructor: Emily Bullock Yowell, Ph.D.
وكالة الكلية للجودة والتطوير
Measurement Concepts and scale evaluation
Presentation transcript:

Other Measurement Validity Types

OverviewOverview l Face validity l Content validity l Criterion-related validity l Predictive validity l Concurrent validity l Construct validity –Convergent validity –Discriminant validity

Face Validity l The measure seems valid “on its face”. l A judgment call. l Probably the weakest form of measurement validity Scan a multitude of information and decide what is important Manage time effectively 2Manage resources effectively. 3Scan a multitude of information and decide what is important. 4Decide how to manage multiple tasks. 5Organize the work when directions are not specific. 1Manage time effectively Rating Sheet

Content Validity l Check the measure against the relevant content domain. l Also a judgment call. l Can make this relatively rigorous with a systematic check Scan a multitude of information and decide what is important Manage time effectively 2Manage resources effectively. 3Scan a multitude of information and decide what is important. 4Decide how to manage multiple tasks. 5Organize the work when directions are not specific. 1Manage time effectively Rating Sheet Content domain

Criterion-Related Validity l Check the measure against a relevant criterion Scan a multitude of information and decide what is important Manage time effectively 2Manage resources effectively. 3Scan a multitude of information and decide what is important. 4Decide how to manage multiple tasks. 5Organize the work when directions are not specific. 1Manage time effectively Rating Sheet Content domain Test

Criterion-Related Validity l Check the measure against a relevant criterion. l The standard is empirical Scan a multitude of information and decide what is important Manage time effectively 2Manage resources effectively. 3Scan a multitude of information and decide what is important. 4Decide how to manage multiple tasks. 5Organize the work when directions are not specific. 1Manage time effectively Rating Sheet Content domain TestCriterion

Predictive Validity l A type of criterion-related validity Scan a multitude of information and decide what is important Manage time effectively 2Manage resources effectively. 3Scan a multitude of information and decide what is important. 4Decide how to manage multiple tasks. 5Organize the work when directions are not specific. 1Manage time effectively Rating Sheet Test

Predictive Validity l A type of criterion-related validity l Look at measure’s ability to predict something it should be able to predict Scan a multitude of information and decide what is important Manage time effectively 2Manage resources effectively. 3Scan a multitude of information and decide what is important. 4Decide how to manage multiple tasks. 5Organize the work when directions are not specific. 1Manage time effectively Rating Sheet TestCriterion

Concurrent Validity l A type of criterion-related validity

Concurrent Validity l A type of criterion-related validity, l Does the measure distinguish between groups that it should distinguish between?

Concurrent Validity l A type of criterion-related validity l Does the measure distinguish between groups that it should distinguish between? l Example: a measure of empowerment should show higher scores for managers and lower scores for their workers.

Relationships Among Validity Types l Almost all can be considered a sub- case of construct validity. l Construct validity is the most encompassing and comprehensive standard.