Spanish and English Neuropsychological Assessment Scales - Guiding Principles and Evolution Friday Harbor Psychometrics Workshop 2005.

Slides:



Advertisements
Similar presentations
Cross Cultural Research
Advertisements

Luria-Nebraska Neuropsychological Battery
Issues Related to Assessment with Diverse Populations
Part II Knowing How to Assess Chapter 5 Minimizing Error p115 Review of Appl 644 – Measurement Theory – Reliability – Validity Assessment is broader term.
DAWN STEWART BSC, MPA, PHD BRS 214 Introduction to Psychology Rehabilitation interventions and clinical psychology.
Copyright © 2008 Pearson Education, inc. or its affiliates. All rights reserved. An Introduction to Advanced Clinical Solutions for the WAIS-IV and WMS-IV.
Tony WAEGEMANS, MD UCB Pharma, Belgium. TW/ll/ Washington/MCI 2 MCI as implemented in our study MCI is a very early stage of dementia with as main.
Health-related quality of life in diabetic patients and controls without diabetes in refugee camps in Gaza strip: a cross-sectional study By: Ashraf Eljedi:
The Effects of Increased Cognitive Demands on the Written Discourse Ability of Young Adolescents Ashleigh Elaine Zumwalt Eastern Illinois University.
Screening By building screening for symptoms of VCI into regular workflows or practice, health care providers are participating in Taking Action to address.
1 Evaluating Psychological Tests. 2 Psychological testing Suffers a credibility problem within the eyes of general public Two main problems –Tests used.
Author: Sabrina Hinton. Year and Publisher: American Guidance Service.
Test Validity S-005. Validity of measurement Reliability refers to consistency –Are we getting something stable over time? –Internally consistent? Validity.
Educational level relative to gender (Ν=28)
Translation and Cross-Cultural Equivalence of Health Measures.
Learning Disability Identification Engaging in Expert Dialogue.
Naglieri Nonverbal Ability Test (NNAT) Miami-Dade County Public Schools NNAT Workshop March 26, 28, & 29, 2007.
WHAT WE LEARNED In a clinically-referred, assisted living sample: 1.NAB Judgment (NAB-JDG) scores displayed good internal consistency reliability. 2.NAB-JDG.
EVIDENCE ABOUT DIAGNOSTIC TESTS Min H. Huang, PT, PhD, NCS.
Competency in Older Adults: Clinical and Legal Perspectives The Role of Cognitive and Neuropsychological Evaluations John Crumlin, PhD Assistant Director,
Measuring Human Intelligence with Artificial Intelligence Adaptive Item Generation Sangyoon Yi Susan E. Embretson.
Survey of alternative uses of ACTIVE data, review of completed work and lessons learned Friday Harbor Advanced Psychometrics Workshop June 9-13, 2014 Presenter:
Friday Harbor Psychometrics 2012 Scientific Summary UC Davis / SENAS (Spanish and English Neuropsychological Assessment Scales)
An Innovative Approach to Fair Evaluations for People with Cognitive Disabilities.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 15 Developing and Testing Self-Report Scales.
Psychological Testing
Antonio E. Puente University of North Carolina Wilmington LOST IN TRANSLATION: IS IT BACK TO FUTURE OR FUTURE TO THE BACK.
Spring 2015 Kyle Stephenson
Translation and Cross-Cultural Equivalence of Health Measures
Leiter International Performance Scale – Revised
Item Response Theory Dan Mungas, Ph.D. Department of Neurology
Chapter 3 Selection of Assessment Tools. Council of Exceptional Children’s Professional Standards All special educators should possess a common core of.
Item Response Theory Dan Mungas, Ph.D. Department of Neurology University of California, Davis.
Chapter 11 - Intelligence Do I belong in this class? Just Kidding.
UC Davis Alzheimer’s Disease Center The Residual Approach to Measuring Cognitive Reserve in Aging and Dementia Bruce Reed & Dan Mungas University of California,
Instrument Development and Psychometric Evaluation: Scientific Standards May 2012 Dynamic Tools to Measure Health Outcomes from the Patient Perspective.
Copyright © 2009 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 47 Critiquing Assessments.
All Hands Meeting 2004 Ontologies for Data Mediation Christine Fennema-Notestine, Ph.D.
Understanding Populations & Samples
Understanding Populations & Samples
Aka STEEL VALLEY SENIORS SURVEY (SVSS)
Friday Harbor Laboratory University of Washington August 22-26, 2005
Lorna Myers, Ph.D. Director of Clinical Neuropsychology
What is cognitive psychology?
QDET2, Miami, FL, Hibiscus A
Principles of Language Assessment
Chapter 4 Research Methods in Clinical Psychology
Intelligence Andrea Mejia Spring 2017.
Early Diagnosis of ASD In a Community Sample: Who Refers and Why?
A valid Spanish neuropsychological battery for epilepsy and beyond
Ron D. Hays GIM-HSR Friday Noon Seminar Series November 4, 2016
Test Validity.
FUNDING ACKNOWLEDGEMENT
METHODOLOGY AND MEASUREMENT ASPECTS
Associations Between Regional Brain Volumes and the NIH-Toolbox Cognition Battery Fluid and Crystallized Composite Scores in Cognitively Healthy Older.
Paul K. Crane, MD MPH Dan M. Mungas, PhD
Week 3 Class Discussion.
Designed for individuals ages 16 and older.
Made for individuals ages birth to 89 years
Early Cognitive Decline and the Aging Brain - Overview
Early Diagnosis of ASD In a Community Sample: Who Refers and Why?
The influence of social and cultural factors on memory
Friday Harbor Laboratory University of Washington August 27-31, 2006
Studies of Cognitive Reserve in WHICAP
UC Davis Data Summary Psychometrics 2018.
Parent Alliance Measure By: Richard R. Abidin & Timothy R. Konold
Evaluating Multi-item Scales
Improving cognitive function to improve diabetes self-management
Neurodevelopmental Testing Services through CTSI
Chapter 3: How Standardized Test….
Presentation transcript:

Spanish and English Neuropsychological Assessment Scales - Guiding Principles and Evolution Friday Harbor Psychometrics Workshop 2005

A Brief Detour Th(eta) estimation - a simple minded approach Information Friday Harbor Psychometrics Workshop 2005

P(yij=1|£)=1/(1+exp(-aj(£i-bj)) Friday Harbor Psychometrics Workshop 2005

Basic Data Structure Subject Item1 Item2 Item3 Item4 S1 X11 X12 X13 Friday Harbor Psychometrics Workshop 2005

Sample size considerations Large samples required for stable estimation 150-200 for 1PL 400-500 for 2PL 600-1000 for 3PL Friday Harbor Psychometrics Workshop 2005

Information Curves Friday Harbor Psychometrics Workshop 2005

Back to Our Regular Program Friday Harbor Psychometrics Workshop 2005

Purpose of SENAS Project Create matched English and Spanish language neuropsychological tests for ages 60+ New scales based upon neuropsychological model of cognitive functioning Scales psychometrically matched Within English and Spanish language versions Between English and Spanish language versions Distribution of item difficulty appropriate to elderly population Friday Harbor Psychometrics Workshop 2005

Psychometric Considerations Concept of item and test bias central to project A test is biased if its validity for measuring a particular attribute is different in different groups Bias is present if individuals from different groups having the same ability have a different expected score Empirical question Definition of ability Capacity to successfully respond to test items Net result of all genetic and environmental influences Measured by scales composed of homogenous items Friday Harbor Psychometrics Workshop 2005

Guiding Principles Initial Scale Development Scales targeted to assess neuropsychologically relevant cognitive domains Domains that are affected by dementia and other age-related causes of cognitive impairment Verbal and non-verbal measures Non-timed New scales, not translations of existing scales Examiner administered Item generation 90-100 items generated per scale to comprise initial item pool Broad range of difficulty Friday Harbor Psychometrics Workshop 2005

Original SENAS Scales and Abilities Measured Friday Harbor Psychometrics Workshop 2005

Psychometric Methods Based upon Item Response Theory Modern approach to psychometric test development Item selection Identify items without language DIF Based upon empirical data Use these items as foundation for scale construction Add English and Spanish items to achieve target test information curve Friday Harbor Psychometrics Workshop 2005

Friday Harbor Psychometrics Workshop 2005

Friday Harbor Psychometrics Workshop 2005

English and Spanish Item Characteristic Curves for “Stone/Piedra” Item Friday Harbor Psychometrics Workshop 2005

English and Spanish Item Characteristic Curves for “Lamb/Cordero” Item Friday Harbor Psychometrics Workshop 2005

Model for Item Selection Friday Harbor Psychometrics Workshop 2005

Test Information for 3MS and SENAS Object Naming Friday Harbor Psychometrics Workshop 2005

Initial Subject Sample Community dwelling older persons (60+) English or Spanish speakers 208 English 200 Spanish Recruited using representative sampling methods and targeted outreach Hispanics and non-Hispanics (mainly Caucasians) Used for preliminary item calibration and selection Friday Harbor Psychometrics Workshop 2005

Phase 2 Data Collection English Administration SALSA Hispanics Random Sample (All scales) - 141 Screened (Subset of scales) - 156 Woodland Community Sample - 153 Spanish Administration Random Sample (All scales) - 264 Screened (Subset of scales) - 287 Used for item calibration and scale construction Friday Harbor Psychometrics Workshop 2005

Scales by Information Values High - 10-12 Object Naming Picture Association Spatial Localization Verbal Attention Visual Attention Verbal Comprehension Verbal Memory 1 Moderate - 8-10 Verbal Conceptual Pattern Recognition Verbal Memory 2 Low - 4-8 Verbal Expression Non-Verbal Conceptual Friday Harbor Psychometrics Workshop 2005

Phase 3 Data Collection New goals Measures of executive function Fluency Working memory African American recruitment and evaluation Additional Hispanics and Caucasian recruitment and validation Friday Harbor Psychometrics Workshop 2005

Phase 3 Data Collection Community recruitment - health care systems and community outreach 200 African Americans 300 Hispanics 200 Caucasians Full spectrum of cognitive ability Friday Harbor Psychometrics Workshop 2005

Clinical Diagnosis by Ethnicity Friday Harbor Psychometrics Workshop 2005

Supplementary Data Demographic and linguistic variables Reading measures Clinical variables Diagnosis, global cognition, global function Volumetric MRI Brain matter, white matter hyperintensity, hippocampus Friday Harbor Psychometrics Workshop 2005

Previous Work Scale construction and psychometric characteristics Mungas et al., Neuropsychology, 2000 Mungas et al., Psychological Assessment, 2004 Friday Harbor Psychometrics Workshop 2005

Previous Work Scale construction and psychometric characteristics Mungas et al., Neuropsychology, 2000 Mungas et al., Psychological Assessment, 2004 Impact of DIF (Object Naming) Friday Harbor Psychometrics Workshop 2005

Mean Object Naming Ability by Group DIF Adjusted and Unadjusted Friday Harbor Psychometrics Workshop 2005

Mean White-Hispanic Difference in Object Naming Ability Friday Harbor Psychometrics Workshop 2005

Previous Work Scale construction and psychometric characteristics Mungas et al., Neuropsychology, 2000 Mungas et al., Psychological Assessment, 2004 Impact of DIF (Object Naming) Demographic effects - Hispanics and Caucasians Mungas et al., Neuropsychology, 2005 Friday Harbor Psychometrics Workshop 2005

Language Utilization English and Spanish How well do you speak English 0 - Not at all 1 - A little 2 - Well 3 - Very well How well do you speak Spanish Friday Harbor Psychometrics Workshop 2005

Ethnicity Effect Sizes for Raw Scores and Demographically Adjusted Scores Friday Harbor Psychometrics Workshop 2005

Previous Work External validation Global cognition/function, Hispanics and Caucasians Mungas et al., Neuropsychology, 2000 Mungas et al., Neuropsychology, 2005 Clinical diagnosis, Hispanics and Caucasians Mungas et al., JINS, 2005 Friday Harbor Psychometrics Workshop 2005

Cognition by Clinical Diagnosis for Hispanics and Caucasians Friday Harbor Psychometrics Workshop 2005

New Data Adjustment for reading and education 114 African Americans 145 Hispanics 77 Caucasians Friday Harbor Psychometrics Workshop 2005

Ethnicity Effect Sizes for Raw Scores and Demographically Adjusted Scores Friday Harbor Psychometrics Workshop 2005

New Data Adjustment for reading and education Age and education effects on relationship with MRI Friday Harbor Psychometrics Workshop 2005

MRI Effect Sizes and Age and Education Adjustment - Full Sample (n=135) Friday Harbor Psychometrics Workshop 2005

MRI Effect Sizes and Age and Education Adjustment - Whites (n=68) Friday Harbor Psychometrics Workshop 2005

MRI Effect Sizes and Age and Education Adjustment - Minorities (n=67) Friday Harbor Psychometrics Workshop 2005

Questions Measurement characteristics in more specific ethnic/linguistic groups Especially different English speakers Hispanics, African Americans, Caucasians DIF other than language Psychometric properties of executive measures Friday Harbor Psychometrics Workshop 2005

Questions Deconstructing ethnic differences in distributions of test scores Premorbid ability or expected test score Broader external validation Clinical diagnosis (including African Americans) MRI Friday Harbor Psychometrics Workshop 2005