Reliability and Validity Scale Evaluation Reliability Validity Test-Retest Internal Consistency Alternative Forms Construct Criterion Content Convergent.

Slides:

Advertisements

Similar presentations

 Degree to which inferences made using data are justified or supported by evidence  Some types of validity ◦ Criterion-related ◦ Content ◦ Construct.

Advertisements

Survey Methodology Reliability and Validity EPID 626 Lecture 12.

Taking Stock Of Measurement. Basics Of Measurement Measurement: Assignment of number to objects or events according to specific rules. Conceptual variables:

VALIDITY AND RELIABILITY

Psychological Testing Principle Types of Psychological Tests  Mental ability tests Intelligence – general Aptitude – specific  Personality scales Measure.

Reliability - The extent to which a test or instrument gives consistent measurement - The strength of the relation between observed scores and true scores.

Measurement Reliability and Validity

CH. 9 MEASUREMENT: SCALING, RELIABILITY, VALIDITY

5/15/2015Marketing Research1 MEASUREMENT  An attempt to provide an objective estimate of a natural phenomenon ◦ e.g. measuring height ◦ or weight.

Chapter 4 Validity.

Test Validity: What it is, and why we care.

RELIABILITY & VALIDITY What is Reliability? What is Reliability?What is Reliability?What is Reliability? How Can We Measure Reliability? How Can We Measure.

PERSONALITY. Major Issues n Theoretical vs. Psychometric base n Nature vs. Nurture n Administration n Culture bias? Free? Fair?

RELIABILITY & VALIDITY

Measurement Concepts. CONSTRUCT VALIDITY OF MEASURES Indicators of Construct Validity Face validity Aggression questionnaire Not enough to really determine.

The Multitrait-Multimethod Matrix. What Is the MTMM Matrix? An approach developed by Campbell, D. and Fiske, D. (1959). Convergent and Dicriminant Validation.

Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.

Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.

Crash Course in Psychometric Theory David B. Flora SP Area Brownbag February 8, 2010.

Choosing tests for EEF evaluations – reliability and validity and other issues Steve Higgins & Carole Torgerson

Business Research Method Measurement, Scaling, Reliability, Validity

Research Method Step 1 – Formulate research question Step 2 – Operationalize concepts ◦ Valid and reliable indicators Step 3 – Decide on sampling technique.

Measurement, Scales and Attitudes. Nominal Ordinal?

Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.

Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.

More Validity And some reliability. Today’s class Check in Validity In class exercise Reliability.

Validity. Face Validity  The extent to which items on a test appear to be meaningful and relevant to the construct being measured.

MGTO 324 Recruitment and Selections Validity I (Construct Validity) Kin Fai Ellick Wong Ph.D. Department of Management of Organizations Hong Kong University.

Validity and Reliability THESIS. Validity u Construct Validity u Content Validity u Criterion-related Validity u Face Validity.

ScWk 240 Week 6 Measurement Error Introduction to Survey Development “England and America are two countries divided by a common language.” George Bernard.

Reliability vs. Validity.  Reliability  the consistency of your measurement, or the degree to which an instrument measures the same way each time it.

METHOD in Personality Research. How do we gather data? 1. From whom??? 1. From whom??? A. Self A. Self B. Others B. Others Plus/Minus? Plus/Minus?

Measurement Models: Exploratory and Confirmatory Factor Analysis James G. Anderson, Ph.D. Purdue University.

Research methods in clinical psychology: An introduction for students and practitioners Chris Barker, Nancy Pistrang, and Robert Elliott CHAPTER 4 Foundations.

Psychometrics & Validation Psychometrics & Measurement Validity Properties of a “good measure” –Standardization –Reliability –Validity A Taxonomy of Item.

Types of Validity Content Validity Criterion Validity Construct Validity Predictive Validity Concurrent Validity Convergent Validity Discriminant Validity.

Session 4 Reliability and Validity. Validity What does the instrument measure and How well does it measure what it is supposed to measure? Is there enough.

Validity Validity: A generic term used to define the degree to which the test measures what it claims to measure.

Evaluating Survey Items and Scales Bonnie L. Halpern-Felsher, Ph.D. Professor University of California, San Francisco.

Designs and Reliability Assessing Student Learning Section 4.2.

More Validity And some reliability. More validity Construct validity Content validity Face validity Concurrent validity Predictive validity Discriminant.

Testing, Measurement & Assessment Unit 5 Seminar - Validity.

Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.

MEASUREMENT. MeasurementThe assignment of numbers to observed phenomena according to certain rules. Rules of CorrespondenceDefines measurement in a given.

Validity and Item Analysis Chapter 4. Validity Concerns what the instrument measures and how well it does that task Not something an instrument has or.

Introducing Communication Research 2e © 2014 SAGE Publications Chapter Five Measurement: Research Using Numbers.

Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”

Measurement and Scaling

MTMM Byrne Chapter 10. MTMM Multi-trait multi-method – Traits – the latent factors you are trying to measure – Methods – the way you are measuring the.

1 Psychology 305A: Personality Psychology January 14 Lecture 3.

CJT 765: Structural Equation Modeling Class 8: Confirmatory Factory Analysis.

Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.

Chapter Ten. Figure 10.1 Relationship of Noncomparative Scaling to the Previous Chapters and the Marketing Research Process Focus of This Chapter Relationship.

Issues in Personality Assessment

Validity & Reliability. OBJECTIVES Define validity and reliability Understand the purpose for needing valid and reliable measures Know the most utilized.

Classroom Assessment Chapters 4 and 5 ELED 4050 Summer 2007.

Lab 6 Validity. Picking a Topic for Your Paper Were you able to come up with 3 ideas? Let’s chat about some of the ideas to make sure we’re all on the.

Measuring Research Variables

Consistency and Meaningfulness Ensuring all efforts have been made to establish the internal validity of an experiment is an important task, but it is.

Survey Methodology Reliability and Validity

MGMT 588 Research Methods for Business Studies

Ch. 5 Measurement Concepts.

Test Design & Construction

Evaluation of measuring tools: validity

Tests and Measurements: Reliability

پرسشنامه کارگاه.

5. Reliability and Validity

Reliability, validity, and scaling

وكالة الكلية للجودة والتطوير

How can one measure intelligence?

Presentation transcript:

Reliability and Validity Scale Evaluation Reliability Validity Test-Retest Internal Consistency Alternative Forms Construct Criterion Content Convergent Validity Discriminant Validity Nomological Validity

Determination of Validity and Reliability

Multitrait - Multimethod Matrix (Campbell & Fiske, 1959) b 1 = reliability for method 1 v a = convergent validity for both methods wrt trait a m 1 = discriminant validity for method 1 d= “nonsense”-correlation Requirements: v > 0 and "high enough" v > d v > m d low Correlation coefficients {

Example Mosher Forced Choice Guilt Scale 3 traits Guilt feelings about sex Hostile guilt Guilt concerning morality 3 methods Incomplete sentences "When I dream about sex …" Forced choice " When I dream about sex …" a) I don't remember a thing in the morning b) I feel happy when I get up True/False "When I dream about sex I wake up feeling happy"

MTMM matrix for the Mosher Forced Choice Guilt Scale Sexual Hostile Morality FC very reliable, TF too, IS not Good convergent validity Discriminant validity OK