Considerations in Comparing Groups of People with PROs Ron D. Hays, Ph.D. UCLA Department of Medicine May 6, 2008, 3:45-5:00pm ISPOR, Toronto, Canada.

Slides:



Advertisements
Similar presentations
Differential Item Functioning of the English- and Spanish-Administered HINTS Psychological Distress Scale Chih-Hung Chang, Ph.D. Feinberg School of Medicine.
Advertisements

Conceptualization and Measurement
How does PROMIS compare to other HRQOL measures? Ron D. Hays, Ph.D. UCLA, Los Angeles, CA Symposium 1077: Measurement Tools to Enhance Health- Related.
PROMIS DEVELOPMENT METHODS, ANALYSES AND APPLICATIONS Presented at the Patient-Reported Outcomes Measurement Information System (PROMIS): A Resource for.
PROMIS: The Right Place at the Right Time? David Cella, Ph.D. Department of Medical Social Sciences Northwestern University Chair, PROMIS Steering Committee.
15-minute Introduction to PROMIS Ron D. Hays, Ph.D UCLA Division of General Internal Medicine & Health Services Research Roundtable Meeting on Measuring.
Why Patient-Reported Outcomes Are Important: Growing Implications and Applications for Rheumatologists Ron D. Hays, Ph.D. UCLA Department of Medicine RAND.
1 Internal and External Validity and Method of Control Ron D. Hays, Ph.D. - UCLA Department of Medicine: Division of General.
Validity and Validation: An introduction Note: I have included explanatory notes for each slide. To access these, you will probably have to save the file.
Social and Behavioral Sciences Assignment 2
1 Health-Related Quality of Life Ron D. Hays, Ph.D. - UCLA Department of Medicine: Division of General Internal Medicine.
Performance of PROMIS® CATs Versus Short forms in Detecting Change Ron D. Hays October 3, 2011 International Association for Computer.
LOINC for Patient-Reported and Clinician-Administered Psychological Tests Saul Rosenberg, PhD Clinical LOINC Meeting January 28, 2011 Tucson, AZ.
Women’s Health in Massachusetts Highlights from the Massachusetts Behavioral Risk Factor Surveillance System (BRFSS): Health Survey Program Bureau.
Student Engagement Survey Results and Analysis June 2011.
Construction and Evaluation of Multi-item Scales Ron D. Hays, Ph.D. RCMAR/EXPORT September 15, 2008, 3-4pm
The emotional distress of children with cancer in China: An Item Response Analysis of C-Ped-PROMIS Anxiety and Depression Short Forms Yanyan Liu 1, Changrong.
A Comprehensive Approach to the Measurement of Health Outcomes Ron D. Hays, Ph.D. UCLA Department of Medicine November 25, 2008 K30 Track II Module Gonda.
Use of Health-Related Quality of Life Measures to Assess Individual Patients July 24, 2014 (1:00 – 2:00 PDT) Kaiser Permanente Methods Webinar Series Ron.
SAS PROC IRT July 20, 2015 RCMAR/EXPORT Methods Seminar 3-4pm Acknowledgements: - Karen L. Spritzer - NCI (1U2-CCA )
1 Lecture #1 Introduction to Outcomes and Effectiveness Research January 5, 2015 (9:00-11:50 am) HPM 214
Possible Selves of New Zealanders: An examination of the Hopes and Fears of young New Zealanders. Presented by Paul Englert.
PROMIS ® : Advancing the Science of PRO measurement Common Data Elements NIH CDE Webinar September 8, 2015 Ashley Wilder Smith, PhD, MPH Chief, Outcomes.
Development of Physical and Mental Health Summary Scores from PROMIS Global Items Ron D. Hays ( ) UCLA Department of Medicine
Introduction to the Patient-Reported Outcomes Measurement Information System (PROMIS) UCLA Center for East-West Medicine 2428 Santa Monica Blvd., Suite.
Healthy People 2010 Focus Area 6: Disability and Secondary Conditions Progress Review November 16, 2006.
VALIDITY AND VALIDATION: AN INTRODUCTION Note: I have included explanatory notes for each slide. To access these, you will probably have to save the file.
MEASUREMENT: SCALE DEVELOPMENT Lu Ann Aday, Ph.D. The University of Texas School of Public Health.
Measurement Issues by Ron D. Hays UCLA Division of General Internal Medicine & Health Services Research (June 30, 2008, 4:55-5:35pm) Diabetes & Obesity.
1 11/17/2015 Psychometric Modeling and Calibration Ron D. Hays, Ph.D. September 11, 2006 PROMIS development process session 10:45am-12:30 pm.
Impact of using a next button in a web-based health survey on time to complete and reliability of measurement Ron D. Hays (Rita Bode, Nan Rothrock, William.
Brandon Vaughn University of Texas at Austin
Item Response Theory (IRT) Models for Questionnaire Evaluation: Response to Reeve Ron D. Hays October 22, 2009, ~3:45-4:05pm
NATIONAL CONFERENCE ON STUDENT ASSESSMENT JUNE 22, 2011 ORLANDO, FL.
Psychometric Evaluation of Questionnaire Design and Testing Workshop December , 10:00-11:30 am Wilshire Suite 710 DATA.
Overlap between Subjective Well-being and Health-related Quality of Life. 3 Ron D. Hays, Ph.D. (Alina Palimaru) November 18, 2015 (11:30-12:00 noon) Geriatric.
Measurement of Outcomes Ron D. Hays Accelerating eXcellence In translational Science (AXIS) January 17, 2013 (2:00-3:00 pm) 1720 E. 120 th Street, L.A.,
Highlights of Current Research Ron Hays UCLA GIM/HSR Introduction to Fellows August 10, 2007 ~ 12:19 pm.
Ensuring Consistency in Assessment of Continuing Care Needs: An Application of Differential Item Functioning Analysis R. Prosser, M. Gelin, D. Papineau,
Patient-Reported Physical Functioning Ron D. Hays November 27, 2012 (11:15-11:30) UCLA Department of Medicine MCID for Orthopaedic Devices Silver Springs,
Reader’s Digest Introduction to Health-Related Quality of Life Ron D. Hays, Ph.D. UCLA Department of Medicine April 25, 2008 (Signature Grand) Nova Southeastern.
TOMS/NOMS FY12- FY14 Adult Survey Analysis: Does treatment lead to changes over time? 2/16/2016 Prepared by: Abigail Howard, Ph.D.
Impact of using a next button in a web-based health survey on time to complete and reliability of measurement Ron D. Hays (Rita Bode, Nan Rothrock, William.
Overview of Item Response Theory Ron D. Hays November 14, 2012 (8:10-8:30am) Geriatrics Society of America (GSA) Pre-Conference Workshop on Patient- Reported.
Health-Related Quality of Life in Outcome Studies Ron D. Hays, Ph.D UCLA Division of General Internal Medicine & Health Services Research GCRC Summer Session.
Health-Related Quality of Life (HRQOL) Assessment in Outcome Studies Ron D. Hays, Ph.D. UCLA/RAND GCRC Summer Course “The.
Leaping Ahead: 4-H Public Speaking Life Skills Evaluation Report by Ben Silliman, Youth Development Specialist.
Reducing Burden on Patient- Reported Outcomes Using Multidimensional Computer Adaptive Testing Scott B. MorrisMichael Bass Mirinae LeeRichard E. Neapolitan.
Instrument Development and Psychometric Evaluation: Scientific Standards May 2012 Dynamic Tools to Measure Health Outcomes from the Patient Perspective.
Introduction to Neuro-QoL
Introduction to ASCQ-MeSM
Psychometric Evaluation of Items Ron D. Hays
QDET2, Miami, FL, Hibiscus A
NIH: Patient-Reported Outcomes Measurement Information System (PROMIS®) Ron D. Hays Functional Vision and Visual Function November 10, 2016, 8:55-9:15am.
UCLA Department of Medicine
UCLA Department of Medicine
Evaluating Multi-Item Scales
Ron D. Hays GIM-HSR Friday Noon Seminar Series November 4, 2016
WG Mental Health Work Group Examination of Anxiety and Depression in Cameroon, Canada, India and the United States Islay Mactaggart Research Fellow in.
UCLA Department of Medicine
Evaluating IRT Assumptions
Introduction to ASCQ-Me®
Introduction to Neuro-QoL
Introduction to Neuro-QoL
Introduction to ASCQ-Me®
A Multi-Dimensional PSER Stopping Rule
Evaluating Multi-item Scales
Evaluating Multi-item Scales
How to Measure Quality of Life
Patient-reported Outcome Measures
Presentation transcript:

Considerations in Comparing Groups of People with PROs Ron D. Hays, Ph.D. UCLA Department of Medicine May 6, 2008, 3:45-5:00pm ISPOR, Toronto, Canada

2 Measures taken from the patient 140/ º F or 37.0 º C

3 Measures given by the patient “My health is excellent.” “I get along with my wife.” “I have a lot of energy.” “I am good at my job.” “I can walk a block.” “My vision sucks.”

4 Health-Related Quality of Life What they are able to do And how they feel about their life

5 Skepticism Can be Healthy 2/3 of Canadians believe in angels and 1/2 in spirits and ghosts. Stephen Nancy Margaret

6 “The public believes x-rays and biopsies give clear yes-or-no answers, but that is not the case. They depend on human perception, pattern-recognition, and interpretation. Pathologists and radiologists often disagree with each other and even with themselves (in repeat readings). A radiologist who has recently missed a breast cancer is likely to over-read future mammograms in compensation.”

7

8 Behavioral Risk Factor Surveillance System (BRFSS) Nationwide telephone interview (random digit dialing) of U.S. adults “Would you say in general your health is excellent, very good, good, fair or poor?” Percent fair or poor health about 16%

9 Greater % of fair or poor health reported by older adults (33% for 75+ vs. 9% for 18-24)

10 Greater % of fair or poor health reported by females (17%) vs. males (15%)

11 Don’t Assume Equivalence Evaluate by –Individual characteristics ( age, gender, race, language, etc.) –Site (including country) –Administration effects Order Time Mode Form

12 very lowsevere Depressive Symptoms Never Rarely Some times Often Always In the past 7 days, I felt unhappy. Item Response Theory (IRT) Category Response Curves

13 Location DIF Slope DIF Differential Item Functioning (2-Parameter Model) U. S. Canada U.S.

14 Psycho- metric Testing Item Bank (IRT-calibrated items reviewed for reliability, validity, and sensitivity) Short Form Instruments CAT Items from Instrument A Item Pool Items from Instrument B Items from Instrument C New Items  Questionnaire administered to large representative sample             Secondary Data Analysis Cognitive Testing Focus Groups Content Expert Review

15 Item Response Theory (IRT): Item Information Functions I felt unhappy. I felt depressed. I withdrew from other people. I felt worthless. I felt I had no reason for living. very lowsevere Depression 1.Never 2.Rarely 3.Sometimes 4.Often 5.Always

16 Computerized Adaptive Testing (CAT) Estimate person’s score (e.g., depressive symptoms) iteratively Administer most informative item Stop when desired level of precision is reached.

17 Respondent (n = 752) Characteristics Responded to the 28 items in the PROMIS depressive symptoms item bank –Mean age = 51 (18-93 range) –52% female –78% white, 10% Hispanic, 10% black –22% high school graduate or less

18 Form A Items (Least to Most Severe) #In the past 7 days… 2I felt disappointed in myself. 4I felt discouraged about the future. 10I found that things in my life were overwhelming. 18I felt like a failure. 21I felt that I had nothing to look forward to. 24I felt that nothing could cheer me up. 26I felt worthless. 28I felt I had no reason for living. Response Options: Never, Rarely, Sometimes, Often, Always

19 Form B Items (Least to Most Severe) #In the past 7 days… 1I felt sad. 3I felt unhappy. 9I felt depressed. 17I felt that nothing was interesting. 19I felt that my life was empty. 23I felt helpless. 25I felt hopeless. 27I felt I wanted to give up on everything. Response Options: Never, Rarely, Sometimes, Often, Always

20 Mean, Minimum and Maximum Scores Form A (8 items) Form B (8 items) CAT (8 items) Full Bank (28 items) Mean49 Minimum Maximum respondents in PROMIS

21 Correlations Among 8-Item Forms and 28-Item Bank Form AForm BCAT Form A 1.00 Form B CAT Bank

22 Scale Score Comparisons: Short Forms, CAT (8 items) and Full-Bank (28 Items)

23 Person Fit Can Also Be Evaluated Z L has expected value of zero, with variance of one (if person responds according to the estimated IRT model). Large negative Z L values (>= 2.0) indicate misfit.

24 Summary PROs (HRQOL) are as reliable as other measures used to assess patient health. Equivalence of PROs for different groups needs to be demonstrated. IRT provides strong empirical basis for evaluating equivalence

25 Thank you. Ron D. Hays, Ph.D., UCLA Department of Medicine 911 Broxton Avenue, Room 110 Los Angeles, Ca Preparation of this presentation was supported in part by the National Institutes of Health through the NIH Roadmap for Medical Research Grant (AG015815), PROMIS Project.