NIH Toolbox Assessment of Neurological and Behavioral Function This study is funded in whole or in part with Federal funds from the Blueprint for Neuroscience.

Slides:



Advertisements
Similar presentations
Measures for Social and Behavioral Determinants of Health
Advertisements

Progress Monitoring. Progress Monitoring Steps  Monitor the intervention’s progress as directed by individual student’s RtI plan  Establish a baseline.
Developmental Profile 3
Interpreting and Using ePIPS(P3,5,7) Feedback Glasgow 13 th February 2013.
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT
How does PROMIS compare to other HRQOL measures? Ron D. Hays, Ph.D. UCLA, Los Angeles, CA Symposium 1077: Measurement Tools to Enhance Health- Related.
PROMIS DEVELOPMENT METHODS, ANALYSES AND APPLICATIONS Presented at the Patient-Reported Outcomes Measurement Information System (PROMIS): A Resource for.
PROMIS: The Right Place at the Right Time? David Cella, Ph.D. Department of Medical Social Sciences Northwestern University Chair, PROMIS Steering Committee.
Group 2: Rae, Jenna, & Katie. Purpose  The purpose of this study was to determine the effect Tai Chi has on tension headaches  Independent variable=
15-minute Introduction to PROMIS Ron D. Hays, Ph.D UCLA Division of General Internal Medicine & Health Services Research Roundtable Meeting on Measuring.
The Effects of Achievement Priming on Expectations and Performance Kathryn Raso Team 14 PSY 321.
Evaluating Deaf Individuals with Additional Disabilities Donna Morere, Ph.D. Gallaudet University.
INTRODUCTIONRESULTS PURPOSE METHODS CONCLUSION The Correlation between Parental Perception of Movement Difficulties and Scoring on a Motor Proficiency.
What Do We Measure? Intelligence Achievement Personality Symptoms Memory Vocational match Perception Social skills Stress Coping Etc, etc etc. Can psychologists.
The Effects of Increased Cognitive Demands on the Written Discourse Ability of Young Adolescents Ashleigh Elaine Zumwalt Eastern Illinois University.
What Do We Measure? Intelligence Achievement Personality Symptoms Memory Vocational match Perception Social skills Stress Coping Etc, etc etc. Can psychologists.
Psychometric Properties of the Job Search Self-Efficacy Scale Investigators: Jeff Christianson Cody Foster Jon Ingram Dan Neighbors Faculty Mentor: Dr.
Bruininks-Oserentsky Test of Motor Proficiency- 2nd Edition
Florida Assessments for Instruction in Reading aligned to the Language Arts Florid Standards FAIR-FS Purpose Presented by Mrs. DeSousa.
Stanford-Binet IV Description: –Point-scale (contrast with age-scale of previous editions) –Test composite (M=100, SD=16) –4 areas & scores (M=100, SD=16)
ACT on Alzheimer’s Disease Curriculum Module VI: Screening.
INTELLIGENCE AND PSYCHOLOGICAL TESTING. KEY CONCEPTS IN PSYCHOLOGICAL TESTING Psychological test: a standardized measure of a sample of a person’s behavior.
Copyright restrictions may apply JAMA Pediatrics Journal Club Slides: Music in the Pediatric Emergency Department Hartling L, Newton AS, Liang Y, et al.
Author: Sabrina Hinton. Year and Publisher: American Guidance Service.
1 Reducing the duration and cost of assessment with the GAIN: Computer Adaptive Testing.
LOINC for Patient-Reported and Clinician-Administered Psychological Tests Saul Rosenberg, PhD Clinical LOINC Meeting January 28, 2011 Tucson, AZ.
FDA Approach to Review of Outcome Measures for Drug Approval and Labeling: Content Validity Initiative on Methods, Measurement, and Pain Assessment in.
Naglieri Nonverbal Ability Test (NNAT) Miami-Dade County Public Schools NNAT Workshop March 26, 28, & 29, 2007.
Unit 11. * intelligence: * aggregate or global capacity * to act purposefully * to think rationally * to deal effectively with the environment * fluid.
PROMIS ® : Advancing the Science of PRO measurement Common Data Elements NIH CDE Webinar September 8, 2015 Ashley Wilder Smith, PhD, MPH Chief, Outcomes.
Arbitre Consulting, Inc.
Development of Physical and Mental Health Summary Scores from PROMIS Global Items Ron D. Hays ( ) UCLA Department of Medicine
Introduction to the Patient-Reported Outcomes Measurement Information System (PROMIS) UCLA Center for East-West Medicine 2428 Santa Monica Blvd., Suite.
PIY Personality Inventory for Youth David Lachar, PhD, and Christian P. Gruber, PhD.
An Innovative Approach to Fair Evaluations for People with Cognitive Disabilities.
Amy Houtrow, MD, PhD, MPH No relevant disclosures
Leiter International Performance Scale – Revised
Differential Ability Scales (DAS-II)
UNIT Standardization and Technical Properties n Standardization Sample n Reliability Studies Internal Consistency Reliabilities at Decision-Making Points.
Educational Research Chapter 8. Tools of Research Scales and instruments – measure complex characteristics such as intelligence and achievement Scales.
Working memory and second language learning Graham Hitch, Meesha Warmington & Swathi Kandru.
The Creative Curriculum ® and OSEP Outcomes April 25, 2006.
Reducing Burden on Patient- Reported Outcomes Using Multidimensional Computer Adaptive Testing Scott B. MorrisMichael Bass Mirinae LeeRichard E. Neapolitan.
February 20, 2014 ASENT Annual Meeting, Bethesda, MD Petra Kaufmann MD MSc Director, Office of Clinical Research National Institute of Neurological Disorders.
The Reliability and Validity of the Neurological Outcome Scale for Traumatic Brain Injury (NOS-TBI) in Persons with Post-Acute Traumatic Brain Injury (TBI)
Test-Retest Reliability of the Work Disability Functional Assessment Battery (WD-FAB) Dr. Leighton Chan, MD, MPH Chief, Rehabilitation Medicine Department.
Introduction to PROMIS®
Introduction to Neuro-QoL
The Behavior Assessment System for Children (BASC)
Introduction to ASCQ-MeSM
Introduction to the NIH Toolbox®
NIH: Patient-Reported Outcomes Measurement Information System (PROMIS®) Ron D. Hays Functional Vision and Visual Function November 10, 2016, 8:55-9:15am.
Intelligence Andrea Mejia Spring 2017.
Associations Between Regional Brain Volumes and the NIH-Toolbox Cognition Battery Fluid and Crystallized Composite Scores in Cognitively Healthy Older.
Introduction to the NIH Toolbox®
Introduction to ASCQ-Me®
Introduction to PROMIS®
Introduction to Neuro-QoL
Designed for individuals ages 16 and older.
Presentation Appendix
Introduction to PROMIS®
Introduction to Neuro-QoL
Introduction to ASCQ-Me®
Introduction to the NIH Toolbox®
Chris Russell Sam Morgan Hunter College SPED 746
Spanish and English Neuropsychological Assessment Scales - Guiding Principles and Evolution Friday Harbor Psychometrics Workshop 2005.
Making PROs fit your needs: Practical basics of patient reported outcome measures Cindy J. Nowinski, MD, PhD.
Introduction to PROMIS®
International Perthes Study Group
Presentation transcript:

NIH Toolbox Assessment of Neurological and Behavioral Function This study is funded in whole or in part with Federal funds from the Blueprint for Neuroscience Research, National Institutes of Health under Contract No. HHS-N C Richard Gershon Northwestern University For more information, please visit Richard C. Gershon, PhD, PI

 I am primarily funded by numerous NIH and Department of Defense grants and contracts.  I also do minor consulting work for several surgery boards, and educational service providers.

 Coordinate research efforts across Institutes  Reduce duplication of effort  Produce efficiencies of scale  Create new cross-Institute avenues of discovery and translation NIH Blueprint for Neuroscience Research

 Develop unified/integrated measures (assessment tool) of multiple indicators (cognitive, emotional, motor, sensory) of neural and behavioral health functioning for use in large cohort studies and clinical trials  Could be used as a form of “common currency” across diverse study designs and populations  Would maximize yield from large, expensive studies with minimal increment in subject burden and cost NIH Toolbox Goals

Working Teams  Domains  Instrument Development  NIH Project Team  Epidemiology/Biostatistics  Technology  Spanish Language  Multi-Cultural  Pediatric  Geriatric

80 Institutions 256 Scientists & Staff 20,000 Subjects Four 30-minute domain-level batteries (English and Spanish) Fully normed for ages Instruments in total Including 34 Supplemental Instruments

 Applicable across the age span  No intellectual property concerns  Psychometrically sound  Brief, easy to use  Cover the full range of a trait  No Floor Effect  No Ceiling Effect  Available for use across the age span

 Legacy measures can fail to identify treatment success, nor do they typically accurately assess anyone above the mean! 8

 Free access/use of content: ROYALTY FREE!!!!  But, revenue-neutral fees for technology  “Open Access” for research, clinical use and education  But, restricted where exposure would negate the value of the instruments (e.g. NIH Toolbox Cognition Battery)

... or “CAT” is based on Item Response Theory  For Dichotomous Items  Vocabulary  Reading  For Rating Scale Items  Most of the health measures Computer Adaptive Testing

 Shorter  Targeting  Computerized Algorithm What is CAT?

Who uses CAT?

LowPassHigh ?

?

LowPassHigh PASS! 

FAIL    Low Pass High

Sensation Motor Cognition Emotion Toolbox Domains

Executive Function Attention Episodic Memory Language Processing Speed Working Memory

Task: Indicate the direction of a central target flanked by foils in the same (congruent) and opposite (incongruent) orientations Scoring: Algorithm weighting accuracy and reaction time Total time: 4 minutes

Task: Point to/click on picture that shows meaning of the verbally presented word (picture-word matching) Total time: 4 minutes Spanish: Separate but parallel test was developed “BABY”

Executive Function-Set Shifting NIHTB Dimensional Change Card Sort Test (DCCS) Task: Sort by color; sort by shape; shift according to instructions; 3 sets of trials – shape, color, mixed Total time: 4 minutes Validation Measures: DKEFS Measures WCST

Working Memory NIHTB List Sorting Working Memory Test Task: List sequentially presented test items in order of size (and within categories); establishes working memory span Total time: 7 minutes Validation Measures: Wechsler Letter- Number Sequencing PASAT “Pumpkin” “Lemon”` “Apple” “Cat” “Watermelon” “Bear”

Episodic Memory NIHTB Picture Sequence Memory Test Task: Replicate spatial placement of a previously demonstrated sequence of pictures Total time: 7 minutes Validation Measures: RAVLT Word List Brief Visuospatial Memory Test-Rev NEPSY Sentence Repetition

Language NIHTB Oral Reading Recognition Test Task: The participant is asked to read words (or letters) as accurately as possible. Total time: 3 minutes Spanish: Separate but parallel test was developed Validation Measure: Wide Range Achievement Test

Processing Speed NIHTB Pattern Comparison Processing Speed Test Task: Decide as quickly as possible if two items are the same or not Total trials: Single Scoring: Total number of items correctly responded to in 90 seconds Total time: 90 seconds Validation Measure: Wechsler Processing Speed Index

Motor Strength Balance Locomotion EnduranceDexterity

Dexterity is a central component of hand function.

Balance allows people to orient their body in space and maintain an upright posture under a variety of conditions.

The ability to detect sound and use it functionally. English version (Wilson, 2003) and Spanish version (McArdle et al, 2009) Hearing Threshold Test – Automated Audiometry for the NIH Toolbox (AANT) Hearing Handicap Inventory for Adults/Elderly (HHIA/HHIE) (Newman et al, 1990)

► HOTV: Children 3 to 6 years:ETDRS: Ages 7 to 85 years: Vision-Related Quality of Life (VRQOL)

Emotion Psychological Well-Being Positive Affect Life Satisfaction Meaning & Purpose Social Relationships Social Support Companionship Social Distress Positive Social Development Stress & Self- Efficacy Perceived Stress Self-Efficacy Negative Affect Fear Sadness Anger

 4,859 subjects English and Spanish, ages 3-85  1-week retest (N=500)  Stratified random sampling from recruitment lists maintained at ten geographically diverse market research firms  Single year age bands 3-17, 7 adult bands through 85  Census balanced by age, race, ethnicity and education  Separate English and Spanish samples Norming

Since October Studies Initiated 73 primary articles published Cited in 579 articles

A common problem when using a variety of patient-reported outcome measures is the comparability of scales on which the outcomes are reported. Linking establishes relationships between scores on two different measures. The PRO Rosetta Stone (PROsetta Stone®) developed and applied methods to PROMIS and other PCORR instruments with other related instruments (e.g., SF-36, Brief Pain Inventory, CES-D, MASQ, FACIT-Fatigue) to expand the range of PRO assessment options within a common, standardized metric. It provides equivalent scores for different scales that measure the same health outcome.

NIH Toolbox Assessment of Neurological and Behavioral Function This study is funded in whole or in part with Federal funds from the Blueprint for Neuroscience Research, National Institutes of Health under Contract No. HHS-N C Richard Gershon Northwestern University For more information, please visit Richard C. Gershon, PhD, PI