Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.

Slides:



Advertisements
Similar presentations
Measurement Concepts Operational Definition: is the definition of a variable in terms of the actual procedures used by the researcher to measure and/or.
Advertisements

Ch 5: Measurement Concepts
Survey Methodology Reliability and Validity EPID 626 Lecture 12.
Taking Stock Of Measurement. Basics Of Measurement Measurement: Assignment of number to objects or events according to specific rules. Conceptual variables:
MEASUREMENT CONCEPTS © 2012 The McGraw-Hill Companies, Inc.
Chapter 5 Reliability Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006.
© 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Validity and Reliability Chapter Eight.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 5 Reliability.
VALIDITY AND RELIABILITY
Psychological Testing Principle Types of Psychological Tests  Mental ability tests Intelligence – general Aptitude – specific  Personality scales Measure.
Research Methodology Lecture No : 11 (Goodness Of Measures)
Reliability - The extent to which a test or instrument gives consistent measurement - The strength of the relation between observed scores and true scores.
Part II Sigma Freud & Descriptive Statistics
Part II Sigma Freud & Descriptive Statistics
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT
Reliability and Validity of Research Instruments
RESEARCH METHODS Lecture 18
RELIABILITY & VALIDITY What is Reliability? What is Reliability?What is Reliability?What is Reliability? How Can We Measure Reliability? How Can We Measure.
RELIABILITY & VALIDITY
Concept of Measurement
Developing a Hiring System Reliability of Measurement.
Concept of Reliability and Validity. Learning Objectives  Discuss the fundamentals of measurement  Understand the relationship between Reliability and.
BASIC TERMINOLOGY n Test n Measurement n Evaluation.
Conny’s Office Hours will now be by APPOINTMENT ONLY. Please her at if you would like to meet with.
Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.
SELECTION & ASSESSMENT SESSION THREE: MEASURING THE EFFECTIVENESS OF SELECTION METHODS.
Validity, Reliability, & Sampling
Research Methods in MIS
Classroom Assessment A Practical Guide for Educators by Craig A
Validity and Reliability of Research and the Instruments
Reliability and Validity what is measured and how well.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Emily H. Wughalter, Ed.D. Measurement & Evaluation Spring 2010.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
Principles of Test Construction
Psychology 290 Lab #2 Sept. 26 – 28 Types & Parts of Articles Operational Definition Variables Reliability & Validity.
Validity. Face Validity  The extent to which items on a test appear to be meaningful and relevant to the construct being measured.
Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.
Reliability & Validity
Reliability vs. Validity.  Reliability  the consistency of your measurement, or the degree to which an instrument measures the same way each time it.
Measurement Models: Exploratory and Confirmatory Factor Analysis James G. Anderson, Ph.D. Purdue University.
Measurement Validity.
Advanced Research Methods Unit 3 Reliability and Validity.
Session 4 Reliability and Validity. Validity What does the instrument measure and How well does it measure what it is supposed to measure? Is there enough.
Validity Validity: A generic term used to define the degree to which the test measures what it claims to measure.
Class 9 Dependent Variables, Instructions/Literature Review
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
PSY 231: Introduction to Industrial and Organizational Psychology
Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Reliability and Validity in Testing. What is Reliability? Consistency Accuracy There is a value related to reliability that ranges from -1 to 1.
Validity & Reliability. OBJECTIVES Define validity and reliability Understand the purpose for needing valid and reliable measures Know the most utilized.
Measuring Research Variables
Planning an Applied Research Project Chapter 9 – Validity, Reliability, and Credibility in Research © 2014 John Wiley & Sons, Inc. All rights reserved.
WHS AP Psychology Unit 7: Intelligence (Cognition) Essential Task 7-3:Explain how psychologists design tests, including standardization strategies and.
Measurement and Scaling Concepts
Chapter 2 Theoretical statement:
Ch. 5 Measurement Concepts.
Lecture 5 Validity and Reliability
Product Reliability Measuring
Reliability & Validity
Tests and Measurements: Reliability
پرسشنامه کارگاه.
5. Reliability and Validity
Chapter 11: Measuring Research Variables
Measurement Concepts and scale evaluation
Ch 5: Measurement Concepts
Presentation transcript:

Lecture 7 Psyc 300A

Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other things, we have measurement error Measurement error may include: –Trait error –Method error

Reliability Reliabilty = True score/(true score + error) Refers to stability of a measure: Is it repeatable? Types (all use correlation coefficient) –Test-retest –Alternate forms –Internal consistency –Interrater

Validity Extent to which a procedure measures what it is supposed to measure Types of Validity (measurement) Criterion validity –Extent to which scores predict some current or future situation –Predictive: future event –Concurrent: current event Content

Validity (continued) Types of Validity Construct validity –Extent to which scores reflect hypothetical construct –Convergent: Extent to which two different measures of the same thing are consistent –Divergent: Extent to which two different measures of different things are different from one another