Impact of Using Raw Versus Uniform T Scores in Minnesota Multiphasic Personality Inventory-2 Restructured Form Descriptive and Inferential Research Jayme Luna and Katrina Conen Supervised by: Danielle Burchett California State University, Monterey Bay In collaboration with: Anthony M. Tarescavage Kent State University & David M. Glassmire Patton State Hospital
Research on Standardized Tests https://cdn.theconversation.com/files/57399/width926/q53gbx33-1409053589.jpg
MMPI-2-RF 338-item self-report measure Assess personality & psychopathology dysfunction Used in clinical and other settings (Tellegen & Ben-Porath, 2008/2011)
Raw Scores Responses on subsets of items are used to calculate scores on scales Number of items answered on a scale in a keyed direction https://s3-us-west-2.amazonaws.com/courses-images-archive-read-only/wp-content/uploads/sites/902/2015/02/23225029/CNX_Psych_11_09_MMPI.jpg
Standardized Scores Aid interpreting results Start with raw scores Example IQ tests (M = 100 / SD = 15) Comparison of differences http://www.rutherfordiq.com/static/images/distributioncurve.png
Uniform T Scores Alternative standardized score Specific to the MMPI M = 50 / SD = 10 Positively skewed because symptom-based items are rarely endorsed by most people (Tellegen & Ben-Porath, 1992; Ben-Porath, 2012)
Uniform T Scores “Smoothing” process Comparable to general population Same distributional shape Same severity level Comparable to general population (Tellegen & Ben-Porath, 1992; Ben-Porath, 2012)
Anxiety Depression Psychotic 65T Uniform T 30 50 70 120T
Current Study Importance IRB approval was obtained Researchers use raw scores Clinicians use Uniform T scores A head-to-head comparison of raw and Uniform T has not been conducted for the MMPI-2-RF IRB approval was obtained We interpreted results and read relative literature http://therapy2thrive.com/wp-content/uploads/2016/01/Therapist-Cartoon.jpg http://clipart-library.com/images/8cAbqdnki.jpg
Participants 764 psychiatric inpatients at a forensic state hospital Committed for: Incompetency to stand trial Insanity at time of offense Transferred from a prison for psychiatric treatment https://www.google.com/search?q=linda+vista+community+hospital&espv=2&source=lnms&tbm=isch&sa=X&ved=0ahUKEwjn0oOI2JLTAhUDzWMKHeudBGsQ_AUIBygC&biw=1366&bih=638#imgrc=k0x80M0rnb--CM:
Participants Most patients living with severe psychological illnesses Schizophrenia Bipolar Disorder Major Depressive Disorder Substance Abuse Antisocial Personality Disorder https://img.clipartfest.com/1a13fbb1a2a774b4d94f3440b4a1f20f_download-this-image-as-free-clipart-stick-figure-people-in-a-group_600-474.png
Internalizing, Thought, and Externalizing Disorder Scales Internalizing Disorder Scales Thought Disorder Scales Externalizing Disorder Scales Emotional/Internalizing Dysfunction (EID) Thought Dysfunction (THD) Behavioral/Externalizing Dysfunction (BXD) Demoralization (RCd) Ideas of Persecution (RC6) Antisocial Behavior (RC4) Low Positive Emotions (RC2) Aberrant Experiences (RC8) Hypomanic Activation (RC9) Dysfunctional Negative Emotions (RC7) (Ben-Porath & Tellegen, 2008; Romero, Toorabally, Burchett, Tarescavage, & Glassmire 2016)
Hypothesis: Skewness and Kurtosis No Skew Skewness = 0 Leptokurtic Kurtosis = 1 We predicted Uniform T scores would have a less normal distribution Some Positive Skew Skewness = 1 Mesokurtic Kurtosis = 0 Platykurtic Kurtosis = -1 Notable Positive Skew Skewness = 2 https://brownmath.com/stat/shape.htm
Hypothesis: Scale Intercorrelations and Point Biserial Correlations No Association r = 0.00 rpb = 0.00 We predicted raw scores would have somewhat stronger correlations with relevant psychiatric diagnostic criteria We predicted raw scores would have slightly stronger scale intercorrelations 1 Modest Positive Association r = 0.25 rpb = 0.20 Strong Positive Association r = 0.70 rpb = 0.60 1
Results
Table 2. MMPI-2-RF Scale Raw and Uniform T Score Intercorrelations (n = 764) Raw Score (below) / Uniform T Score (Right) EID RCd RC2 RC7 THD RC6 RC8 BXD RC4 RC9 EID Emotional/Internalizing Dysfunction .99* .91* .70* .75* .45* .44* .46* .33* .42* .31* RCd Demoralization .92* .53* .74* .49* .52* .39* .48* RC2 Low Positive Emotions .55* 1.00* .25* .14* .17* .12* -0.01 .15* -.19* RC7 Dysfunctional Negative Emotions .59* .54* .62* .47* THD Thought Dysfunction .13* .58* .98* .85* .87* .29* .51* RC6 Ideas of Persecution .18* .88* .97* .24* .23* .43* RC8 Aberrant Experiences .63* .65* .41* .38* .57* BXD Behavioral / Externalizing Dysfunction .32* .30* .40* RC4 Antisocial Behavior .28* .22* .37* RC9 Hypomanic Activation -.18* .61* .56* Note. *p < .01. Raw score intercorrelations are presented below the diagonal. Uniform T score intercorrelations are presented above the diagonal. Raw/T intercorrelations are presented on the diagonal. Shading indicates correlations in the same domain of psychopathology. Rounded truncated Uniform T scores are examined.
M SD Min. Max. Skewness Kurtosis rpb with Dx. INTERNALIZING DYSFUNCTION SCALES EID Emotional/Internalizing Dysfunction (raw) 10.33 8.02 38 1.03 0.46 .19 EID Emotional/Internalizing Dysfunction (T) 49.84 11.93 30T 89T 0.71 0.16 .18 RCd Demoralization (raw) 5.83 5.72 23 1.00 0.00 .17 RCd Demoralization (T) 52.08 11.48 37 85 0.62 -0.29 RC2 Low Positive Emotions (raw) 4.35 3.28 17 0.98 0.81 .11 RC2 Low Positive Emotions (T) 51.11 12.61 34 99 0.91 0.68 RC7 Dysfunctional Negative Emotions (raw) 5.40 4.81 21 0.92 0.07 RC7 Dysfunctional Negative Emotions (T) 48.05 11.04 86 0.88 0.41 THOUGHT DYSFUNCTION SCALES THD Thought Dysfunction (raw) 3.53 3.83 20 1.52 0.09 .07 THD Thought Dysfunction (T) 56.51 14.72 39T 100T 0.95 .08 RC6 Ideas of Persecution (raw) 2.48 2.89 16 1.46 1.80 .03 RC6 Ideas of Persecution (T) 60.39 15.64 43 100 -0.20 .04 RC8 Aberrant Experiences (raw) 2.96 3.02 15 1.28 1.30 .06 RC8 Aberrant Experiences (T) 53.82 12.21 39 96 0.75 0.18 EXTERNALIZING DYSFUNCTION SCALES BXD Behavioral / Externalizing Dysfunction (raw) 8.20 22 0.38 -0.38 .20 BXD Behavioral/Externalizing Dysfunction (T) 55.69 11.06 32T 92T .21 RC4 Antisocial Behavior (raw) 7.78 4.29 0.37 -0.53 RC4 Antisocial Behavior (T) 58.95 11.94 93 0.34 -0.42 RC9 Hypomanic Activation (raw) 9.79 5.37 27 0.48 -0.43 RC9 Hypomanic Activation (T) 46.55 10.79 25 88 0.52
M SD Min. Max. Skewness Kurtosis rpb with Dx. INTERNALIZING DYSFUNCTION SCALES EID Emotional/Internalizing Dysfunction (raw) 10.33 8.02 38 1.03 0.46 .19 EID Emotional/Internalizing Dysfunction (T) 49.84 11.93 30T 89T 0.71 0.16 .18 RCd Demoralization (raw) 5.83 5.72 23 1.00 0.00 .17 RCd Demoralization (T) 52.08 11.48 37 85 0.62 -0.29 RC2 Low Positive Emotions (raw) 4.35 3.28 17 0.98 0.81 .11 RC2 Low Positive Emotions (T) 51.11 12.61 34 99 0.91 0.68 RC7 Dysfunctional Negative Emotions (raw) 5.40 4.81 21 0.92 0.07 RC7 Dysfunctional Negative Emotions (T) 48.05 11.04 86 0.88 0.41 THOUGHT DYSFUNCTION SCALES THD Thought Dysfunction (raw) 3.53 3.83 20 1.52 0.09 .07 THD Thought Dysfunction (T) 56.51 14.72 39T 100T 0.95 .08 RC6 Ideas of Persecution (raw) 2.48 2.89 16 1.46 1.80 .03 RC6 Ideas of Persecution (T) 60.39 15.64 43 100 -0.20 .04 RC8 Aberrant Experiences (raw) 2.96 3.02 15 1.28 1.30 .06 RC8 Aberrant Experiences (T) 53.82 12.21 39 96 0.75 0.18 EXTERNALIZING DYSFUNCTION SCALES BXD Behavioral / Externalizing Dysfunction (raw) 8.20 22 0.38 -0.38 .20 BXD Behavioral/Externalizing Dysfunction (T) 55.69 11.06 32T 92T .21 RC4 Antisocial Behavior (raw) 7.78 4.29 0.37 -0.53 RC4 Antisocial Behavior (T) 58.95 11.94 93 0.34 -0.42 RC9 Hypomanic Activation (raw) 9.79 5.37 27 0.48 -0.43 RC9 Hypomanic Activation (T) 46.55 10.79 25 88 0.52
M SD Min. Max. Skewness Kurtosis rpb with Dx. INTERNALIZING DYSFUNCTION SCALES EID Emotional/Internalizing Dysfunction (raw) 10.33 8.02 38 1.03 0.46 .19 EID Emotional/Internalizing Dysfunction (T) 49.84 11.93 30T 89T 0.71 0.16 .18 RCd Demoralization (raw) 5.83 5.72 23 1.00 0.00 .17 RCd Demoralization (T) 52.08 11.48 37 85 0.62 -0.29 RC2 Low Positive Emotions (raw) 4.35 3.28 17 0.98 0.81 .11 RC2 Low Positive Emotions (T) 51.11 12.61 34 99 0.91 0.68 RC7 Dysfunctional Negative Emotions (raw) 5.40 4.81 21 0.92 0.07 RC7 Dysfunctional Negative Emotions (T) 48.05 11.04 86 0.88 0.41 THOUGHT DYSFUNCTION SCALES THD Thought Dysfunction (raw) 3.53 3.83 20 1.52 0.09 .07 THD Thought Dysfunction (T) 56.51 14.72 39T 100T 0.95 .08 RC6 Ideas of Persecution (raw) 2.48 2.89 16 1.46 1.80 .03 RC6 Ideas of Persecution (T) 60.39 15.64 43 100 -0.20 .04 RC8 Aberrant Experiences (raw) 2.96 3.02 15 1.28 1.30 .06 RC8 Aberrant Experiences (T) 53.82 12.21 39 96 0.75 0.18 EXTERNALIZING DYSFUNCTION SCALES BXD Behavioral / Externalizing Dysfunction (raw) 8.20 22 0.38 -0.38 .20 BXD Behavioral/Externalizing Dysfunction (T) 55.69 11.06 32T 92T .21 RC4 Antisocial Behavior (raw) 7.78 4.29 0.37 -0.53 RC4 Antisocial Behavior (T) 58.95 11.94 93 0.34 -0.42 RC9 Hypomanic Activation (raw) 9.79 5.37 27 0.48 -0.43 RC9 Hypomanic Activation (T) 46.55 10.79 25 88 0.52
Table 2. MMPI-2-RF Scale Raw and Uniform T Score Intercorrelations (n = 764) Raw Score (below) / Uniform T Score (Right) EID RCd RC2 RC7 THD RC6 RC8 BXD RC4 RC9 EID Emotional/Internalizing Dysfunction .99* .91* .70* .75* .45* .44* .46* .33* .42* .31* RCd Demoralization .92* .53* .74* .49* .52* .39* .48* RC2 Low Positive Emotions .55* 1.00* .25* .14* .17* .12* -0.01 .15* -.19* RC7 Dysfunctional Negative Emotions .59* .54* .62* .47* THD Thought Dysfunction .13* .58* .98* .85* .87* .29* .51* RC6 Ideas of Persecution .18* .88* .97* .24* .23* .43* RC8 Aberrant Experiences .63* .65* .41* .38* .57* BXD Behavioral / Externalizing Dysfunction .32* .30* .40* RC4 Antisocial Behavior .28* .22* .37* RC9 Hypomanic Activation -.18* .61* .56* Note. *p < .01. Raw score intercorrelations are presented below the diagonal. Uniform T score intercorrelations are presented above the diagonal. Raw/T intercorrelations are presented on the diagonal. Shading indicates correlations in the same domain of psychopathology. Rounded truncated Uniform T scores are examined.
Table 2. MMPI-2-RF Scale Raw and Uniform T Score Intercorrelations (n = 764) Raw Score (below) / Uniform T Score (Right) EID RCd RC2 RC7 THD RC6 RC8 BXD RC4 RC9 EID Emotional/Internalizing Dysfunction .99* .91* .70* .75* RCd Demoralization .92* .53* .74* RC2 Low Positive Emotions .55* 1.00* .25* RC7 Dysfunctional Negative Emotions THD Thought Dysfunction .98* .85* .87* RC6 Ideas of Persecution .88* .97* .62* RC8 Aberrant Experiences .65* BXD Behavioral / Externalizing Dysfunction RC4 Antisocial Behavior .49* RC9 Hypomanic Activation Note. *p < .01. Raw score intercorrelations are presented below the diagonal. Uniform T score intercorrelations are presented above the diagonal. Raw/T intercorrelations are presented on the diagonal. Shading indicates correlations in the same domain of psychopathology. Rounded truncated Uniform T scores are examined.
Discussion Skewness and kurtosis values higher for raw scores Greater non-normality of raw score distributions Compared to Uniform T scores Recommend the use of Uniform T scores Differences are modest, so the existing research is still applicable
Limitations and Future Studies Specific population setting Future Studies Replication Wider variety of external criteria https://www.google.com/search?q=future&source=lnms&tbm=isch&sa=X&ved=0ahUKEwi977u22pLTAhVG5GMKHfxjCEAQ_AUICigD&biw=1366&bih=638#tbm=isch&q=the+future+sign&imgrc=a3Ue4Y6BhNd-wM:
Acknowledgments and References Thank you for making this project possible: University of Minnesota Press Dr. Glassmire of Patton State Hospital Dr. Tarescavage of Kent State University Dr. Burchett of CSUMB CSUMB Undergraduate Research Opportunities Center (UROC) American Psychiatric Association. (2000). Diagnostic and Statistical Manual of Mental Disorders: DSM-IV-TR, Fourth Edition, Text Revision. Washington, DC. Ben-Porath, Y. S. (2003). Assessing personality and psychopathology with self-report inventories. In J. Graham & J. Naglieri (Eds.), Handbook of psychology, Volume 10: Assessment psychology (pp. 553-577). Hoboken, NJ: John Wiley & Sons, Inc. Ben-Porath, Y. S. (2012). Interpreting the MMPI-2-RF. Minneapolis: University of Minnesota Press. Ben-Porath, Y. S., & Tellegen, A. (2008/2011). MMPI-2-RF: Manual for administration, scoring, and interpretation. Minneapolis: University of Minnesota Press. Graham, J. R. (2012). MMPI-2: Assessing personality and psychopathology (5th ed.). New York: Oxford University Press. Kreuger, R.F., Caspi, A., Moffitt, T. E., & Silva, P. A. (1998). The structure and stability of common mental disorders (DSM-III-R): A longitudinal-epidemiological study. Journal of Abnormal Psychology, 107(2), 216-227. Romero, I. E., Toorabally, N., Burchett, D., Tarescavage, A. M., & Glassmire, D. M. (2016). Mapping the MMPI–2–RF substantive scales onto internalizing, externalizing, and thought dysfunction dimensions in a forensic inpatient setting. Journal of Personality Assessment. Advance online publication. DOI: 10.1080/00223891.2016.1223681 Tellegen, A., & Ben-Porath, Y. S. (2008/2011). MMPI-2-RF technical manual. Minneapolis: University of Minnesota Press. van der Heijden, P.T., Egger, J. M., Rossi, G. P., & Derksen, J. L. (2012). Integrating psychopathology and personality disorders conceptualized by the MMPI-2-RF and the MCMI-III: A structural validity study. Journal of Personality Assessment, 94(4), 345-357.
Questions? Clinical and Forensic Evaluation (CAFE) Lab