Health-Related Quality of Life Measures (HS249T: Decision Analysis and Cost-Effectiveness Analysis) Ron D. Hays, Ph.D. (drhays@ucla.edu) UCLA Division.

Slides:



Advertisements
Similar presentations
How does PROMIS compare to other HRQOL measures? Ron D. Hays, Ph.D. UCLA, Los Angeles, CA Symposium 1077: Measurement Tools to Enhance Health- Related.
Advertisements

PROMIS: The Right Place at the Right Time? David Cella, Ph.D. Department of Medical Social Sciences Northwestern University Chair, PROMIS Steering Committee.
15-minute Introduction to PROMIS Ron D. Hays, Ph.D UCLA Division of General Internal Medicine & Health Services Research Roundtable Meeting on Measuring.
Why Patient-Reported Outcomes Are Important: Growing Implications and Applications for Rheumatologists Ron D. Hays, Ph.D. UCLA Department of Medicine RAND.
Cross-Cultural Use of Measurements: Development of the Chinese SF-36 Health Survey Xinhua S. Ren, Ph.D. Boston University School of Public Health, Boston,
1 8/14/2015 Evaluating the Significance of Health-Related Quality of Life Change in Individual Patients Ron Hays October 8, 2004 UCLA GIM/HSR.
1 Health-Related Quality of Life Ron D. Hays, Ph.D. - UCLA Department of Medicine: Division of General Internal Medicine.
Performance of PROMIS® CATs Versus Short forms in Detecting Change Ron D. Hays October 3, 2011 International Association for Computer.
Primer on Evaluating Reliability and Validity of Multi-Item Scales Questionnaire Design and Testing Workshop October 25, 2013, 3:30-5:00pm Wilshire.
Measuring AgrAbility Outcomes with Quality of Life Indicators Robert A. Wilson, Ph.D., M.Sc. University of Delaware Center for Applied Demography and Survey.
Basic Methods for Measurement of Patient-Reported Outcome Measures Ron D. Hays, Ph.D. UCLA/RAND ISOQOL Conference on.
1 Health-Related Quality of Life as an Indicator of Quality of Care Ron D. Hays, Ph.D. HS216—Quality Assessment: Making the Business Case.
 Course materials copyrighted 2003 by Ron D. Hays Measurement of Health-Related Quality of Life Outcomes Ron D. Hays, Ph.D. January 29,
1 9/14/2015 Options for Summarizing the SF-36 Health Survey in Health-Related Quality of Life Research Ron D. Hays, Ph.D. NCI, March 29, 2007 (11:00-11:59.
Ron D. Hays, Ph.D. Use of Preference-Based Health-Related Quality of Life Measures in Cost-Effectiveness Studies (HLT POL 239B) February.
Profile Health-Related Quality of Life Measures
Use of Health-Related Quality of Life Measures to Assess Individual Patients July 24, 2014 (1:00 – 2:00 PDT) Kaiser Permanente Methods Webinar Series Ron.
Patient-Centered Outcomes of Health Care Comparative Effectiveness Research February 3, :00am – 12:00pm CHS 1 Ron D.Hays, Ph.D.
Health-Related Quality of Life as an Indicator of Quality of Care May 4, 2014 (8:30 – 11:30 PDT) HPM216: Quality Assessment/ Making the Business Case for.
Measures Preference-Based Measures Ron D. Hays, Ph.D. February 9, 2004.
1 Assessing the Minimally Important Difference in Health-Related Quality of Life Scores Ron D. Hays, Ph.D. UCLA Department of Medicine October 25, 2006,
Health-Related Quality of Life Measures (HLT POL 239B)
Measuring Health-Related Quality of Life Ron D. Hays, Ph.D. UCLA Department of Medicine RAND Health Program UCLA Fielding School of Public Health
Development of Physical and Mental Health Summary Scores from PROMIS Global Items Ron D. Hays ( ) UCLA Department of Medicine
Preference-Based Health-Related Quality of Life Measures Ron D. Hays, Ph.D. January 26, 2015 (9:00-11:50 am) HPM 214
Measuring Health-Related Quality of Life
Overview of Health-Related Quality of Life Measures May 22, 2014 (1:00 – 2:00 PDT) Kaiser Methods Webinar Series 1 Ron D.Hays, Ph.D.
Introductory Statistics Options, Spring 2008 Stat 100: MWF, 11:00 Science Center C. Stat 100: MWF, 11:00 Science Center C. –General intro to statistical.
1 Health-Related Quality of Life Assessment as an Indicator of Quality of Care (HPM 216) Ron D. Hays April 11, 2013(8:30-11:30 am) Wilshire Blvd.
1 Session 6 Minimally Important Differences Dave Cella Dennis Revicki Jeff Sloan David Feeny Ron Hays.
Item Response Theory (IRT) Models for Questionnaire Evaluation: Response to Reeve Ron D. Hays October 22, 2009, ~3:45-4:05pm
Measurement of Outcomes Ron D. Hays Accelerating eXcellence In translational Science (AXIS) January 17, 2013 (2:00-3:00 pm) 1720 E. 120 th Street, L.A.,
1 2/13/2016 Health-Related Quality of Life Assessment as an Indicator of Quality of Care Ron D. Hays, Ph.D. HS249F January 30, 2008 (3:30-6:30 pm) RAND.
Considerations in Comparing Groups of People with PROs Ron D. Hays, Ph.D. UCLA Department of Medicine May 6, 2008, 3:45-5:00pm ISPOR, Toronto, Canada.
Estimating Minimally Important Differences on PROMIS Domain Scores Ron D. Hays UCLA Department of Medicine/Division of General Internal Medicine & Health.
Health-Related Quality of Life in Outcome Studies Ron D. Hays, Ph.D UCLA Division of General Internal Medicine & Health Services Research GCRC Summer Session.
Health-Related Quality of Life (HRQOL) Assessment in Outcome Studies Ron D. Hays, Ph.D. UCLA/RAND GCRC Summer Course “The.
July 18, 2017, 9:00-11:00 am (Geffen Hall Seminar Room 112)
Introduction to ASCQ-MeSM
Psychometric Evaluation of Items Ron D. Hays
NIH: Patient-Reported Outcomes Measurement Information System (PROMIS®) Ron D. Hays Functional Vision and Visual Function November 10, 2016, 8:55-9:15am.
Patient Baseline Assessment
UCLA Department of Medicine
PROMIS-29 V2.0 Physical and Mental Health Summary Scores Ron D. Hays
UCLA Department of Medicine
Introduction to ASCQ-Me®
Health-Related Quality of Life Assessment in Outcome Studies
Introduction to ASCQ-Me®
The Impact of Pain Management on Quality of Life
A Multi-Dimensional PSER Stopping Rule
Poorer sleep quality among adult patients with pectus excavatum in Taiwan: A pilot study  Yeung-Leung Cheng, MD, PhD, Chou-Chin Lan, MD, PhD, Yao-Kuang.
Impact of Mode and Order of Administration on Generic HRQOL Scores
Patient-Centered Outcomes of Health Care
May 14, :00-12:00 noon (Geffen Hall 207)
Evaluating the Psychometric Properties of Multi-Item Scales
Evaluating Multi-item Scales
Health-Related Quality of Life as an indicator of Quality of Care
ID Dr. Natālija Nikrus, Dr. Maija Vikmane, Prof. Oskars Kalējs
Mean individual and summative SF-36 V2 scores before and 3 months after ablation. Mean individual and summative SF-36 V2 scores before and 3 months after.
Measuring outcomes Emma Frew October 2012.
Patient-Reported Indicators of Quality of Care
Estimating Minimally Important Differences (MIDs)
Introduction to Psychometric Analysis of Survey Data
Health-Related Quality of Life as an indicator of Quality of Care
Geffen Hall 122, Los Angeles, CA, June 10, 2019
Evaluating the Significance of Individual Change
GIM & HSR Research Seminar: October 5, 2018
How to Measure Quality of Life
Patient-reported Outcome Measures
Post hoc analysis of differences from placebo in the percentage of patients reporting improvements ≥MCID at week 24. Post hoc analysis of differences from.
Presentation transcript:

Health-Related Quality of Life Measures (HS249T: Decision Analysis and Cost-Effectiveness Analysis) Ron D. Hays, Ph.D. (drhays@ucla.edu) UCLA Division of General Internal Medicine and Health Services Research, Department of Medicine 911 Broxton Avenue, 2nd Floor Conference Room May 11 & 16, 2011, 9-11:00 am http://twitter.com/RonDHays http://gim.med.ucla.edu/FacultyPages/Hays/ 1

Health-Related Quality of Life is … What you can do. Functioning Self-care Role Social How you feel about your life. Well-being Emotional well-being Pain Energy

HRQOL is Multi-Dimensional Physical Mental Social

HRQOL is Not Quality of environment Type of housing Level of income Social Support

Types of HRQOL Measures - Profile: Generic vs. Targeted - Preference

In general, how would you rate your health? Poor Fair Good Very Good Excellent

SF-36 Generic Profile Measure Physical functioning (10 items) Role limitations/physical (4 items) Role limitations/emotional (3 items) Social functioning (2 items) Emotional well-being (5 items) Energy/fatigue (4 items) Pain (2 items) General health perceptions (5 items)

The following items are about activities you might do during a typical day. Does your health now limit you in these activities? If so, how much? Yes, limited a lot ------> 0 Yes, limited a little ----> 50 No, not limited at all -->100 1. Vigorous activities, such as running, lifting heavy objects, participating in strenuous sports 2. Moderate activities, such as moving a table, pushing a vacuum cleaner, bowling, or playing golf 3. Lifting or carrying groceries 4. Climbing several flights of stairs 5. Climbing one flight of stairs 6. Bending, kneeling, or stooping 7. Walking more than a mile 8. Walking several blocks 9. Walking one block 10. Bathing or dressing yourself

MHI-5 How much of the time during the past 4 weeks: Have you been very nervous? Have you felt so down in the dumps that nothing could cheer you up? Have you felt calm and peaceful? Have you felt down-hearted and depressed? Have you been happy?

Targeted HRQOL Measures Designed to be relevant to particular group. Sensitive to small, but clinically-important changes. More familiar and actionable for clinicians. Enhance respondent cooperation.

Kidney-Disease Targeted Items During the last 30 days, to what extent were you bothered by cramps during dialysis? Not at all bothered Somewhat bothered Moderately bothered Very much bothered Extremely bothered

Scoring HRQOL Scales Average or sum all items in the same scale. Transform average or sum to 0 (worse) to 100 (best) possible range z-score (mean = 0, SD = 1) T-score (mean = 50, SD = 10)

Formula for Transforming Scores (original score - minimum) *100 X = (maximum - minimum) Y = target mean + (target SD * Zx) ZX = SDX (X - X)

Role function-physical SF-36 “Physical Health” Scale Physical Health Physical function Role function-physical Pain General Health 14

SF-36 “Mental Health” Scales Emotional Well-Being Role function-emotional Energy Social function 15

SF-36 PCS and MCS Factor Scoring Coefficients PCS_z = (PF_Z * .42402) + (RP_Z * .35119) + (BP_Z * .31754) + (GH_Z * .24954) + (EF_Z * .02877) + (SF_Z * -.00753) + (RE_Z * -.19206) + (EW_Z * -.22069) MCS_z = (PF_Z * -.22999) + (RP_Z * -.12329) + (BP_Z * -.09731) + (GH_Z * -.01571) + (EF_Z * .23534) + (SF_Z * .26876) + (RE_Z * .43407) + (EW_Z * .48581)

T-score Transformation PCS = (PCS_z*10) + 50 MCS = (MCS_z*10) + 50

Summary scores for SF-36 derived from uncorrelated (orthogonal) two factor (physical and mental health) solution, producing negative weights in scoring. PCS-z = (PF-z*.42) + (RP-z*.35) + (BP-z*.32) + (GH-z*.25) + (EN-z*.03) + (SF-z*-.01) + (RE-z*-.19) + (MH-z*-.22) MCS-z = (PF-z*-.23) + (RP-z*-.12) + (BP-z*-.10) + (GH-z*-.02) + (EN-z*.24) + (SF-z*.27) + (RE-z*.43) + (MH-z*.48) Weights

Physical Functioning and Emotional Well-Being at Baseline for 54 Patients at UCLA-Center for East West Medicine EWB Physical MS = multiple sclerois; ESRD = end-stage renal disease; GERD = gastroesophageal reflux disease. 19

Effect Sizes for Changes in SF-36 Scores 0.13 0.35 0.35 0.21 0.53 0.36 0.11 0.41 0.24 0.30 Energy = Energy/Fatigue; EWB = Emotional Well-being; Gen H=General Health; MCS =Mental Component Summary; Pain = Bodily Pain; PCS = Physical Component Summary; PFI = Physical Functioning; Role-E = Role-Emotional; Role-P = Role-Physical; Social = Social Functioning 20

Significant Improvement in all but 1 of SF-36 Scales (Change is in T-score metric) t-test prob. PF-10 1.7 2.38 .0208 RP-4 4.1 3.81 .0004 BP-2 3.6 2.59 .0125 GH-5 2.4 2.86 .0061 EN-4 5.1 4.33 .0001 SF-2 4.7 3.51 .0009 RE-3 1.5 0.96 .3400 EWB-5 4.3 3.20 .0023 PCS 2.8 3.23 .0021 MCS 3.9 2.82 .0067 21

Defining a Responder: Reliable Change Index (RCI) Note: SDbl = standard deviation at baseline rxx = reliability 22

Amount of Change in Observed Score Needed for Significant Individual Change Scale RCI Effect size Cronbach’s alpha PF-10 8.4 0.67 0.94 RP-4 0.72 0.93 BP-2 10.4 1.01 0.87 GH-5 13.0 1.13 0.83 EN-4 12.8 1.33 0.77 SF-2 13.8 1.07 0.85 RE-3 9.7 0.71 EWB-5 13.4 1.26 0.79 PCS 7.1 0.62 MCS 0.73 23

7-31% of People in Sample Improve Significantly % Improving % Declining Difference PF-10 13% 2% + 11% RP-4 31% + 29% BP-2 22% 7% + 15% GH-5 0% + 7% EN-4 9% SF-2 17% 4% + 13% RE-3 15% EWB-5 19% PCS 24% + 17% MCS 11% 24

Computerized Adaptive Testing (CAT) Select questions based on a person’s response to previously administered questions. Iteratively estimate a person’s standing on a domain (e.g., fatigue, depressive symptoms) Administer most informative items Desired level of precision can be obtained using the minimal possible number of questions.

Physical Functioning Item Bank  50 Physical Functioning Item Bank Item 1 2 3 4 5 6 7 8 9 n Are you able to get in and out of bed? Are you able to stand without losing your balance for 1 minute? Are you able to walk from one room to another? Are you able to walk a block on flat ground? Are you able to run or jog for two miles? Are you able to run five miles?

Reliability and SEM For z-scores (mean = 0 and SD = 1): Reliability = 1 – SEM2 = 0.91 (when SEM = 0.30) = 0.90 (when SEM = 0.32) With 0.90 reliability 95% Confidence Interval z-score: - 0.62  0.62 T-score = (z-score * 10) + 50 T-score: 44  56

Sometimes

Never

Rarely

Never

Sometimes

Rarely

CAT assessments can achieve higher precision than fixed forms SF-36 items CAT 10 items Full Item Bank measurement precision (standard error) normed theta values HAQ items SF-12 items representative sample rheumatoid arthritis patients US-Representative Sample 4 5 3 2 1 10 20 30 40 50 60 70 SE = 3.2 rel = 0.90 SE = 2.2 rel = 0.95 Rose et al, J Clin Epidemiol 2007 (accepted)

PROMIS Banks (454 items) http://www.assessmentcenter.net/ac1/ Physical Function [124] Emotional Distress [86] Depression (28) Anxiety (29) Anger (29) Pain [80] Behavior (39) Impact (41) Fatigue [95] Satisfaction with Participation in Discretionary Social Activities (12) Satisfaction with Participation in Social Roles (14) Sleep Disturbance (27) Wake Disturbance (16)

Interpretation Person Fatigue Score Item Location           Low                    High  Q Q Q Q Likely “I get tired when I run a marathon” Unlikely when I get out of a chair” Item Location Likely item: I get tired when I run a marathon (T) Unlikely item: I get tired when I get out of bed (T)

Interpretation Aids PRO Bank Person Score               Low                     High 30 40 50 60 70 M = 50, SD = 10 T = (z * 10) + 50

Ultimate Use of HRQOL Measures-- Helping to Ensure Access to Cost-Effective Care Effectiveness ↑

Is New Treatment (X) Better Than Standard Care (O)? X X Physical Health X > 0 Mental Health 0 > X

Is Medicine Related to Worse HRQOL? Medication Person Use HRQOL (0-100) 1 No dead 2 No dead 3 No 50 4 No 75 5 No 100 6 Yes 0 7 Yes 25 8 Yes 50 9 Yes 75 10 Yes 100 Group n HRQOL No Medicine 3 75 Yes Medicine 5 50

Direct Preference Measures Underlying attributes unknown Rating Scale Standard gamble Time tradeoff

Overall, how would you rate your current health? Rating Scale Overall, how would you rate your current health? (Circle One Number) 0 1 2 3 4 5 6 7 8 9 10 Worst possible health (as bad or worse than being dead) Half-way between worst and best Best possible health

Alternative 1: Certainty of living in given health state y Alternative 2: Probability of living in full health (x) or immediate death (z)

http://araw.mede.uic.edu/cgi-bin/utility.cgi

Indirect Preference Measures Attributes know and used to estimate societal preferences Quality of Well-Being (QWB) Scale EQ-5D HUI2 and HUI3 SF-6D

Quality of Well-Being (QWB) Scale • Summarize HRQOL in QALYs – Mobility (MOB) – Physical activity (PAC) – Social activity (SAC) – Symptom/problem complexes (SPC) Dead Well-Being 1 • Well-Being Formula: w = 1 + MOB + PAC + SAC + SPC

Quality of Well-Being Weighting Procedure Each page in this booklet tells how an imaginary person is affected by a health problem on one day of his or her life. I want you to look at each health situation and rate it on a ladder with steps numbered from zero to ten. The information on each page tells 1) the person's age group, 2) whether the person could drive or use public transportation, 3) how well the person could walk, 4) how well the person could perform the activities usual for his or her age, and 5) what symptom or problem was bothering the person. Adult (18-65) Drove car or used public transportation without help (MOB) Walked without physical problems (PAC) Limited in amount or kind of work, school, or housework (SAC) Problem with being overweight or underweight (SYM) 1 2 4 3 5 7 8 6 9 10 Perfect Health Death

Quality of Life for Individual Over Time

http://www.ukmi.nhs.uk/Research/pharma_res.asp

Correlations Among Indirect Measures EQ-5D HUI2 HUI3 QWB-SA SF-6D 1.00 0.71 0.68 0.89 QWB 0.64 0.66 0.70 0.69 0.65 Fryback, D. G. et al., (2007). US Norms for Six Generic Health-Related Quality-of-Life Indexes from the National Health Measurement Study. Medical Care, 45, 1162- 1170.

Change in Indirect Preference Measures Over Time Cataract (1 mon. – B) Heart F (6 mons. – B) HUI3 0.05 0.02 HUI2 0.03 0.00 QWB-SA EQ-5D SF-6D 0.01 Kaplan, R. M. et al. (2011). Five preference-based indexes in cataract and heart failure patients were not equally responsive to change. J Clinical Epidemiology, 64, 497-506.