Psychometric Considerations of the MMPI-2 William P. Wattles, Ph.D. Francis Marion University.

Slides:



Advertisements
Similar presentations
Test Development.
Advertisements

Standardized Scales.
Psychometrics William P. Wattles, Ph.D. Francis Marion University.
1 Reliability in Scales Reliability is a question of consistency do we get the same numbers on repeated measurements? Low reliability: reaction time High.
►Identify the importance of text complexity in disciplinary literacy. ►Compare the CCSS grade level expectations for text complexity. ►Identify the three.
Measures of Academic Progress. Make informed instructional decisions  Identify gaps/needs  Support specific skill development across content areas 
Feedback training session
Scales, Transformations, & Norms
Measures of Academic Progress (MAP) Curt Nath Director of Curriculum Ocean City School District.
MULTIPLE REGRESSION. OVERVIEW What Makes it Multiple? What Makes it Multiple? Additional Assumptions Additional Assumptions Methods of Entering Variables.
Questions:  Are behavioral measures less valid and less reliable due to the amount of error that can occur during the tests compared to the other measures?
Appraisal in Counseling Session 2. Schedule Finish History Finish History Statistical Concepts Statistical Concepts Scales of measurement Scales of measurement.
1 General look at testing Taking a step backwards.
Introduction to Psychometrics Psychometrics & Measurement Validity Constructs & Measurement “Kinds” of Items Properties of a “good measure” –Standardization.
Chapter 9 Flashcards. measurement method that uses uniform procedures to collect, score, interpret, and report numerical results; usually has norms and.
1 MMPI-2 William P. Wattles, Ph.D. Francis Marion University.
Assessing Personality
Assessing Personality
Chapter 5 DESCRIBING DATA WITH Z-SCORES AND THE NORMAL CURVE.
Single-Subject Designs
Measurement Concepts & Interpretation. Scores on tests can be interpreted: By comparing a client to a peer in the norm group to determine how different.
Beck’s Depression Inventory BDI-II
Characteristics of Psychological Tests
Now that you know what assessment is, you know that it begins with a test. Ch 4.
But What Does It All Mean? Key Concepts for Getting the Most Out of Your Assessments Emily Moiduddin.
Chapter 9 Quiz Intelligence.
Measures of Academic Progress. Make informed instructional decisions  Identify gaps/needs  Support specific skill development across content areas 
Educational Psychology, 11 th Edition ISBN © 2010 Pearson Education, Inc. All rights reserved. Classroom Assessment, Grading, and Standardized.
GrowingKnowing.com © Variability We often want to know the variability of data. Please give me $1000, I will give you… 8% to 9% in a year. Small.
Standardization the properties of objective tests.
Scoring & Decision Making DeShon Scoring Overview Once you have administered the test and cleaned the data… Once you have administered the test.
The Learning Behaviors Scale
LECTURE 06B BEGINS HERE THIS IS WHERE MATERIAL FOR EXAM 3 BEGINS.
Psychometrics William P. Wattles, Ph.D. Francis Marion University.
Classroom Assessments Checklists, Rating Scales, and Rubrics
Chapter 3 Understanding Test Scores Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition.
Descriptive Statistics
Teaching Today: An Introduction to Education 8th edition
Average Arithmetic and Average Quadratic Deviation.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Psychometrics & Validation Psychometrics & Measurement Validity Properties of a “good measure” –Standardization –Reliability –Validity A Taxonomy of Item.
Experimental Research Methods in Language Learning Chapter 9 Descriptive Statistics.
Assessing Learners with Special Needs: An Applied Approach, 6e © 2009 Pearson Education, Inc. All rights reserved. Chapter 5: Introduction to Norm- Referenced.
Testing College Board’s Curriculum Model Testing and Individual Differences Good Activities!
Psychometrics. Goals of statistics Describe what is happening now –DESCRIPTIVE STATISTICS Determine what is probably happening or what might happen in.
Spring 2015 Kyle Stephenson
Measurement MANA 4328 Dr. Jeanne Michalski
Testing & Intelligence Principal Types of Tests –Personality –Mental ability Intelligence tests – potential for general mental ability Aptitude – potential.
Practice Page 128 –#6.7 –#6.8 Practice Page 128 –#6.7 =.0668 = test scores are normally distributed –#6.8 a =.0832 b =.2912 c =.4778.
Standardized Testing. Basic Terminology Evaluation: a judgment Measurement: a number Assessment: procedure to gather information.
Psych 230 Psychological Measurement and Statistics Pedro Wolf September 16, 2009.
Measures of Academic Progress (MAP) Presenter: Rachel Iaconelli-Scheyer Director of Curriculum Director of Curriculum Ocean City School District Ocean.
The Normal Distribution and Norm-Referenced Testing Norm-referenced tests compare students with their age or grade peers. Scores on these tests are compared.
Characteristics of Psychology Tests
Testing Intelligence. ARE YOU OVER-TESTED?  Your age group is the most tested group in the history of the United States.
LISA A. KELLER UNIVERSITY OF MASSACHUSETTS AMHERST Statistical Issues in Growth Modeling.
Part II – Chapters 6 and beyond…. Reliability, Validity, & Grading.
Educational Research Descriptive Statistics Chapter th edition Chapter th edition Gay and Airasian.
©2013, The McGraw-Hill Companies, Inc. All Rights Reserved Chapter 7 Assessing and Grading the Students.
A Validation of the Sixteen Personality Factor Impression Management Scale and Normative Data for Assessment of Defensiveness in Law Enforcement Applicants.
5. Evaluation of measuring tools: reliability Psychometrics. 2011/12. Group A (English)
Chapter 2 Norms and Reliability. The essential objective of test standardization is to determine the distribution of raw scores in the norm group so that.
Making Sense of Statistics: A Conceptual Overview Sixth Edition PowerPoints by Pamela Pitman Brown, PhD, CPG Fred Pyrczak Pyrczak Publishing.
Assessing Intelligence. Test Construction Standardization – defining the meaning of scores by comparing to a pretested “standard group”. Reliability –
Assessing Personality
EVAAS Overview.
Using the MMPI-A to Identify Students with Emotional Disturbance
Sampling Distributions
Assessing Personality
Parent Alliance Measure By: Richard R. Abidin & Timothy R. Konold
Presentation transcript:

Psychometric Considerations of the MMPI-2 William P. Wattles, Ph.D. Francis Marion University

MMPI/MMPI-2 second most widely used test by clincical psychologists (86%) Translated into more than 50 languages

Original MMPI Published 1943 Paper and pencil improvement on clinical interview and individual psychological testing

Prior to MMPI: Logical Keying Test items generated rationally based on: –Face validity –Subjective judgment Logically keyed items problematic: –Subject to faking –Not always correct

Face Validity Does the test appear to measure what it is purported to Measure?

Face Validity 0 I do not feel sad. 1 I feel sad. 2 I am sad all the time and can't snap out of it. 3 I am so sad or unhappy that I can't stand it.

70. I am easily downed in an argument 89 My hardest values are with myself 267 I have periods in which I feel unusually cheerful without any special reason. 219 I have been disappointed in love

Empirical Keying Original items came from many sources. Pool of 1,000 items reduced to 566 Rewritten to be less formal and allow for some reversal of responses.

Control Group 724 Visitors to the hospital in Minnesota. Representative of Minnesota in the 1930s –16-65 –Average age mind 30’s –Rural –8 th grade education –White

Empirical Keying Using groups of diagnosed patients Contrast and Cross-validation

MMPI vs MMPI 2 Improved norms Score has meaning only when compared to a representative sample. Original sample Caucasian, 35, married, small town, good job. New sample large and more representative. Higher education level than population

MMPI-2 normative group 2600 Participants Paid $15 ($40 for couples) Tested in 7 locations –Minnesota, Ohio, North Carolina, Washington, Pennsylvania, Virginia, California Selected from phone directories

MMPI-2 composition 2600 Participants (started with 2900) –1138 men –1462 women Age (M=41, SD=15) 61% married Education 3-20 years (M=14, SD=2)

MMPI-2 Restandardization Caucasian 81% African-American 12% Hispanic 3% Native-American 3% Asian-American 1%

Requirements Eight Grade reading level required Satisfactory cooperation and commitment to task Internal checks for the above

T Score transformations Transforming a score makes it easier to interpret. 13 validity and clinical scales converted to T scores T score is a standard score with a mean of 50 and a standard deviation of 10. Thus, a 70 is like a Z score of 2

Standard Scores or Z scores Z score: how many standard deviations a score lies above or below the mean.

46 68% 99.7% 95%

Percent of scores falling below

% 84% 97.5%

33 Z-score

33 MMPI-2 T score

MMPI Uniform T score Original linear T- scores were problematic because the underlying data is somewhat skewed. Thus a T score on one scale represented a different percentile than one on another scale

MMPI Uniform T-scores Involve averaging of the T-scores across the scales.

Frequency high points in contemporary settings

T-score cutoff Formerly T-scores of 70 were considered clinically significant. Now the MMPI-2 recommends 65. That puts the score above 93% of those who answer –65-50/10 = 1.5 –1.5 =.9332 area under standard normal curve to the left of Z = 1.5

Intercorrelations There is considerable overlap between some scales. 13 of 39 items in scale 6 also appear in scale 8

Homogeneity of items The empirical keying approach did not favor item homogeneity thus internal consistency is not high.

Temporal Stability Ability, interest and aptitude tests should be high in temporal stability Personality and psychopathology measures less clear.

Test-retest reliability one week

Test-retest reliability Summary. Test is fairly stable and changes when current appear consistent. Significant changes generally correctly reflect behavior change.

Internal consistency Moderate, not a strength for the MMPI-2 due to empirical keying approach.

Factor Analysis Two strong factors identified –General maladjustment and psychotic thought –Neurotic characteristics

Response sets and styles Charges that MMPI and MMPI-2 were confounded by response style. Block modified MMPI to have equal number of true and false items Test seems to be valid in a variety of settings.

MMPI vs MMPI-2 Validity similar Raw Scores higher on MMPI-2 –May be explained by instructions T-scores compensate for higher raw scores

Items changed MMPI-2

Basic Qualifications for users Graduate-level course in psychological testing. –Standard scores –Transformations –Understand limits of accuracy –Standard error of measurement

Basic Qualifications for users Graduate-level course in psychopathology –Personality structure –Dynamics –Deviance psychodiagnostic concepts –Diagnostic systems –Broad understanding of human personality

Lexile Reading Levels in SIRS What Are Lexile Reading Levels Lexile scores match reader ability and text difficulty, allowing individualized monitoring of student progress. Due to the accountability requirements of NCLB, many states are turning to standardized systems for reading which help to track student progress. How does it Work? Lexile measures are based on two well- established predictors of how difficult a text is to comprehend: semantic difficulty (word frequency) and syntactic complexity (sentence length). AgeSchoo l Year Typical Lexile Level Lexile Score Table from

Reading Level

Lexile examples 39 I am an important person 294 I have not lived the right kind of life 603 I do not read every editorial in the newspaper everyday 860 Most anytime I would rather sit and daydream than do anything else I am troubled by discomfort in the pit of my stomach every few days or oftener.

Testing conditions Quiet room one setting preferred Okay to take over several intervals Person must have privacy and no help Simple definitions of words permitted along with rephrasing of colloquialisms Usually sufficient to say: “Just indicate the way you see it.”

Examiner to act in a serious and professional manner Don’t linger too long in one area

The End