Psychological Testing Principle Types of Psychological Tests  Mental ability tests Intelligence – general Aptitude – specific  Personality scales Measure.

Slides:



Advertisements
Similar presentations
Taking Stock Of Measurement. Basics Of Measurement Measurement: Assignment of number to objects or events according to specific rules. Conceptual variables:
Advertisements

Reliability Definition: The stability or consistency of a test. Assumption: True score = obtained score +/- error Domain Sampling Model Item Domain Test.
MEASUREMENT CONCEPTS © 2012 The McGraw-Hill Companies, Inc.
© 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Validity and Reliability Chapter Eight.
Chapter 9: Intelligence and Psychological Testing
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 5 Reliability.
VALIDITY AND RELIABILITY
Reliability - The extent to which a test or instrument gives consistent measurement - The strength of the relation between observed scores and true scores.
Reliability & Validity.  Limits all inferences that can be drawn from later tests  If reliable and valid scale, can have confidence in findings  If.
Part II Sigma Freud & Descriptive Statistics
CLASS 11. INTELLIGENC E  Anything that exists, exists in some amount.  And all amounts can be measured.  Thorndike, 1955 Psychological Measurement.
Part II Sigma Freud & Descriptive Statistics
MEQ Analysis. Outline Validity Validity Reliability Reliability Difficulty Index Difficulty Index Power of Discrimination Power of Discrimination.
Reliability and Validity of Research Instruments
RESEARCH METHODS Lecture 18
Reliability Analysis. Overview of Reliability What is Reliability? Ways to Measure Reliability Interpreting Test-Retest and Parallel Forms Measuring and.
Item PersonI1I2I3 A441 B 323 C 232 D 112 Item I1I2I3 A(h)110 B(h)110 C(l)011 D(l)000 Item Variance: Rank ordering of individuals. P*Q for dichotomous items.
Reliability and Validity
Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.
Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.
PSYCHOMETRICS RELIABILITY VALIDITY. RELIABILITY X obtained = X true – X error IDEAL DOES NOT EXIST USEFUL CONCEPTION.
SELECTION & ASSESSMENT SESSION THREE: MEASURING THE EFFECTIVENESS OF SELECTION METHODS.
Research Methods in MIS
Psychological Testing
Cognitive and Academic Assessment
INTELLIGENCE AND PSYCHOLOGICAL TESTING. KEY CONCEPTS IN PSYCHOLOGICAL TESTING Psychological test: a standardized measure of a sample of a person’s behavior.
Reliability, Validity, & Scaling
Industrial and Organizational Psychology Methods For I/O Research Copyright Paul E. Spector, All rights reserved, March 15, 2005.
Measurement in Exercise and Sport Psychology Research EPHE 348.
Validity and Reliability of Research and the Instruments
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
MEASUREMENT CHARACTERISTICS Error & Confidence Reliability, Validity, & Usability.
Data Analysis. Quantitative data: Reliability & Validity Reliability: the degree of consistency with which it measures the attribute it is supposed to.
Psychometrics William P. Wattles, Ph.D. Francis Marion University.
Principles of Test Construction
Validity. Face Validity  The extent to which items on a test appear to be meaningful and relevant to the construct being measured.
MGTO 324 Recruitment and Selections Validity I (Construct Validity) Kin Fai Ellick Wong Ph.D. Department of Management of Organizations Hong Kong University.
Surveys and Attitude Measurement The reason surveys seem to be everywhere is that they are tremendously flexible— you can ask people about anything, and.
Tests and Measurements Intersession 2006.
Measurement Validity.
Research methods in clinical psychology: An introduction for students and practitioners Chris Barker, Nancy Pistrang, and Robert Elliott CHAPTER 4 Foundations.
Learning Objective Chapter 9 The Concept of Measurement and Attitude Scales Copyright © 2000 South-Western College Publishing Co. CHAPTER nine The Concept.
1 Measurement and Data Collection  What and How?  Types of Scales Nominal Nominal Ordinal Ordinal Interval Interval Ratio Ratio.
Validity Validity: A generic term used to define the degree to which the test measures what it claims to measure.
Chapter 2: Behavioral Variability and Research Variability and Research 1. Behavioral science involves the study of variability in behavior how and why.
Intelligence Lecture 11 Chapter What is Intelligence?
Designs and Reliability Assessing Student Learning Section 4.2.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
Chapter 5: Developing a Measurement Strategy
Measurement Issues General steps –Determine concept –Decide best way to measure –What indicators are available –Select intermediate, alternate or indirect.
Measurement Theory in Marketing Research. Measurement What is measurement?  Assignment of numerals to objects to represent quantities of attributes Don’t.
Measurement MANA 4328 Dr. Jeanne Michalski
©2011 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Psychologist use statistics for 2 things
RESEARCH METHODS IN INDUSTRIAL PSYCHOLOGY & ORGANIZATION Pertemuan Matakuliah: D Sosiologi dan Psikologi Industri Tahun: Sep-2009.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Chapter 6 - Standardized Measurement and Assessment
RELIABILITY BY DONNA MARGARET. WHAT IS RELIABILITY?  Does this test consistently measure what it’s supposed to measure?  The more similar the scores,
CLASS 11. INTELLIGENCE  Anything that exists, exists in some amount.  And all amounts can be measured.  Thorndike, 1955 Psychological Measurement.
Survey Design Class 02.  It is a true measure  Measurement Validity is the degree of fit between a construct and indicators of it.  It refers to how.
Reliability. Basics of test score theory Each person has a true score that would be obtained if there were no errors in measurement. However, measuring.
Modern Tests of Mental Abilities
Measurement Characteristics of Client Assessment
پرسشنامه کارگاه.
5. Reliability and Validity
RESEARCH METHODS Lecture 18
How can one measure intelligence?
Presentation transcript:

Psychological Testing

Principle Types of Psychological Tests  Mental ability tests Intelligence – general Aptitude – specific  Personality scales Measure motives, interests, values, and attitudes

Key Concepts in Psychological Testing  Standardization Test norms Standardization group  Reliability Correlation coefficient  Validity Content validity Criterion-related validity Construct validity

Classical Test Theory  Goal of testing is to identify subject’s “true score” on a given attribute. Classical Test Theory says… Test Score=True Score+Error of Measurement Goal of test developers is to minimize this!

Sources of Measurement Error  Where do these measurement errors come from? Item sampling error Internal consistency error Time sampling error Random error

 Testing  How do psychologists know how well their test is measuring a person’s true score? By assessing test reliability Test-Retest reliability Internal Consistency reliability Alternate or Parallel Form reliability Assesses Time sampling error Assesses Item sampling error Assesses Internal consistency error

Test-Retest Reliability

Q9 Q10 Q17 Q18 Q Q Q Q Correlation Matrix Scale Scale Corrected Mean Variance Item- Squared Alpha if Item if Item Total Multiple if Item Deleted Deleted Correlation Correlation Deleted Q Q Q Q Reliability Coefficients 4 items Alpha =.6846 Standardized item alpha =.6749 I am carefree I am rarely overcome with worries I am not a worrier I rarely feel fearful or anxious Judging Internal Consistency Anxiety Scale Items 9. I am carefree 10. I am rarely overcome with worries 17. I am not a worrier 18. I rarely feel fearful or anxious

 Testing  How do psychologists know their test is measuring what they think it is measuring? By assessing test validity  Content validity  Criterion-related validity  Construct validity

Fig. 9-4, p. 339

Fig. 9-5, p. 340

Assessing Construct Validity Convergent Construct Validity Our measure of extraversion should be correlated with things related to extraversion Divergent Construct Validity Our measure of extraversion should not be correlated with things unrelated to extraversion

Our measure of impatience should not be correlated with things unrelated to impatience. Correlations ** ** HEIGHT SHOE Impatience Scale HEIGHTSHOEEXTRA202 Correlation is significant at the 0.01 level (2-tailed). **. Assessing Construct Validity Convergent Construct Validity Our measure of impatience should be correlated with things related to impatience. Divergent Construct Validity Correlations * *1.000 Impatience Scale ‘02 Impatience Scale ‘03 ‘02‘03 Correlation is significant at the 0.05 level (2-tailed). *.

 Testing  Utility of Psychological Tests Reliability  Alternate or Parallel Form  Internal Consistency  Test-Retest Validity  Content  Criterion-Related  Construct