Validity Scales: Patterns Observed across Veteran Affairs Settings

Slides:



Advertisements
Similar presentations
Victorian Curriculum and Assessment Authority
Advertisements

Working with Rubrics: Using the Oral Communication, Writing, and Critical Thinking Rubrics VALUE Rubrics Ashley Finley, Ph.D Senior Director of Assessment.
Jared Hockly - Western Springs College
A Framework for Classifying Denial of Service Attacks Alefiya Hussain, John Heidemann and Christos Papadopoulos presented by Nahur Fonseca NRG, June, 22.
The Effects of De-listing Publicly Funded Health Care Services Mark Stabile Department of Economics and Center for Economics and Public Affairs University.
Mathematics Assessment Standards The Mathematics Standard-Assessment should reflect the mathematics that all students need to know and be able to do. The.
In what ways are our superstitions and beliefs in the supernatural different to Chinese people?  The following is an example to help with your Tangjia.
TRANSLATING VISITS INTO PATIENTS USING AMBULATORY VISIT DATA (Hypertensive patient case study) by Esther Hing, M.P.H. and Julia Holmes, Ph.D U.S. DEPARTMENT.
Danielle Varda & Carrie Chapman University of Colorado at Denver, School of Public Affairs.
FAEIS Project User Opinion Survey 2005 Thursday, June 23, 2005 Washington, D.C. H. Dean SutphinYasamin Miller ProfessorDirector, SRI Agriculture & Extension.
Investigation into evidence for economies of scale in the water and sewerage industry in England and Wales Presentation of Findings Water UK City Conference,
ATTRIBUTEDESCRIPTION Focal Knowledge, Skills, Abilities The primary knowledge / skills / abilities (KSAs) targeted by this design pattern. RationaleHow/why.
Patterns of Event Causality Suggest More Effective Corrective Actions Abstract: The Occurrence Reporting and Processing System (ORPS) has used a consistent.
Overview of CCSS Statistics and Probability Math Alliance September 2011.
Qualitative or quantitative?. Research methods and statistics We are learning about...We are learning how to... Qualitative and quantitative data. Content.
META-ANALYSIS, RESEARCH SYNTHESES AND SYSTEMATIC REVIEWS © LOUIS COHEN, LAWRENCE MANION & KEITH MORRISON.
A Comparison of General v. Specific Measures of Achievement Goal Orientation Lisa Baranik, Kenneth Barron, Sara Finney, and Donna Sundre Motivation Research.
Teacher Accountability as Formative Assessment: Findings from the National Center on Scaling Up Effective Schools J. Edward Guthrie (Vanderbilt), Christopher.
Chatfield Reservoir Phosphorus Budget Jim Saunders and Jamie Anthony WQCD, Standards Unit 13 Dec 2007.
The Nexus of Traumatic Brain Injury and Epilepsy in Veterans from Afghanistan and Iraq Mary Jo Pugh, PhD South Texas Veterans Health Care System, San Antonio,
Reasoning in Psychology Using Statistics Psychology
© FSAI FSAI Advice-Line Evaluation Survey of Advice-line and Query Users and Mystery Shopper Measurement Evaluation carried out by by Insight Statistical.
Researching Innovation.  By definition, an innovation means that you are testing out something new to see how effective it is.  This also means that.
Abstract Recent studies assessing the neuropsychological effects of PTSD and/or remote mTBI suggest that there is negligible long-term cognitive dysfunction.
VA Office of Mental Health and Suicide Prevention
Sexiness on Social Media Hurts Men Too
Cari-Ana, Alexis, Sean, Matt
DEVELOPING EVIDENCE-BASED PRACTICE IN CHAPLAINCY:
Unit 1 Question Style: USA
The Impact on Clinical, Research, and Disability Findings
Building Public Health System Capacity:
Cody G. Dodd, Nathan C. Weed, & Mark A. Deskovitz
Reasoning in Psychology Using Statistics
Non-Probability sampling methods
Paul B. Ingramac Jackie Bhattaraiac Anthony M. Tarescavageb
Donald E. Cutlip, MD Beth Israel Deaconess Medical Center
How demographics and the economic downturn are affecting the way we live LSE Seminar: 1 July 2013 Neil McDonald: Visiting Fellow CCHPR.
Developing a Methodology
Purpose of Critical Appraisal
Background/Objective
Receiver Interpretations of Emoji Functions: A Gender Perspective
2018 NM Community Survey Data Entry Training
Step 9: Identify your Next 10 Customers
Evaluating Research Is this valid research?.
Win May USC Keck School of Medicine
Levelled Assessment Success Criteria
Single-Case Designs.
EVAAS in the Field Paul Marshall
Assessment of student achievement of outcomes from the 7-10 Science syllabus Use this as a screen saver.
Orchestrating Intelligent Systems
Psych 231: Research Methods in Psychology
Project Title Subtitle: make sure you specify it is a research project
EAST GRADE Course 2019 PICO Question Formulation
Reasoning in Psychology Using Statistics
Assessment Literacy: Test Purpose and Use
Data Analysis – Part1: The Initial Questions of the AFCS
SGM Mid-Year Conference Gina Graham
Ass. Prof. Dr. Mogeeb Mosleh
Reasoning in Psychology Using Statistics
Seeing Patterns and Setting Conditions for Speaking Truth to Power:
An Audit of Nutritional Trace Element Requesting Within York Teaching Hospitals Roger Bramley.
Meta-analysis, systematic reviews and research syntheses
AP U.S. History Exam Details
Authors: Jinliang Fan and Mostafa H. Ammar
VHA Consult Reporting How to Use this Report
Analysis of protein-coding genetic variation in 60,706 humans
Seeing Patterns and Setting Conditions for Speaking Truth to Power:
How to write a Long Essay Question
  Examining the Sensitivity and Incremental Validity of an MMPI-2-RF Combined Response Inconsistency (CRIN) Scale for Detecting Mixed Responding Good Afternoon!
The Nature of learner language
Presentation transcript:

Validity Scales: Patterns Observed across Veteran Affairs Settings Paul B.Ingramab, Anthony M. Tarescavagec, Yossef S. Ben-Porathd, & Mary E. Oehlertb a. Texas Tech University, b. Eastern Kansas Veteran Healthcare System, c. John Carrol University, d. Kent State University

Project Background and Context 7-year national Sample of MMPI-2 and MMPI-2-RF Administrations All service locations within the VA included (Stop Codes) Investigation focuses on outpatient services VA is unique in its evaluative complexity Outline study background, discuss sample and scope of this project -- talk about validity scales within the VA

-- Contrast with Previous VA groups ------ Era breakdown focuses more on Gulf War (e.g., DS1 and OEF,OIF,OND) compared to comparison groups gathered for MMPI-2 [so too with declined others conflicts- WW1 gone, WW2/Korea down, etc] ------ Service Connection is also substantially higher here (45% with SC in psych inpatient comparison group, 15% here WITHOUT SC) suggesting importance of evaluating validity scales -- Contrast two groups and note similarity between valid / full sample Questions about why SC isn’t different may reflect that this does not capture ongoing evaluations / desire for evaluations (e.g., Nelson and colleagues, 2010) Invalidity Criteria: CNS ≥ 18, VRIN-r ≥ 80, TRIN ≥ 80, F-r ≥ 120, and Fp-r ≥ 100.

Overall Scale Cumulative Frequencies Non-Content Based Scales, --- Small portion invalidated through this scale. --- slightly more frequently a fixed responding pattern than random responding Over-Reporting Scales --- substantial portions have elevations which invalidate --- even higher rates classified as within a range which might suggest potentially exaggeration of symptoms Under-Reporting --- Minimal evidence of this pattern

Frequency of Multiple Scale Elevations ---Numbers reflect post NCR exclusion ---37.1% invalidate an over-reporting scale ---Twice as likely to invalidate on multiple over-reporting scales (24.6%) when you are part of that 37.1%

Invalidity By Stopcode Going out of order for a reason that should become apparent.. NCR, UR, then OR Substantial variation across context in rates of invalidity for individual scales and for RF overall.

Conclusions High frequencies of invalidity observed Frequency of uninterpretable profiles varies by service location Over-reporting is most frequent invalidity pattern Most with one over-reporting elevation have multiple scales invalidated