Measurement Problems in the National Healthcare Disparities Report American Public Health Association 135 th Annual Meeting & Exposition, Nov. 3-7,2007,

Slides:



Advertisements
Similar presentations
Government P4P Programs: Pay for Performance - Is Medicare a Good Candidate? Albert W. Morris, Jr., M.D. President National Medical Association The Second.
Advertisements

2008 Joint Statistical Meetings Denver, Colorado, August 2-7, 2008 Evaluating the Size of Differences Between Group Rates in Settings of Different Overall.
REACH Healthcare Foundation Prepared by Mid-America Regional Council 2013 Kansas City Regional Health Assessment.
Unequal Treatment: Confronting Racial and Ethnic Disparities in Healthcare Institute of Medicine.
Chapter 4 The Social Demography of Health: Gender, Age, and Race
Deepa Patel Doctor of Pharmacy Candidate, 2012 Mercer COPHS Presented on July 22, 2011.
American Public Health Association 138 th Annual Meeting Denver, Colorado Nov. 6-10, 2010 The Emerging European Acceptance of Scanlan’s Rule in Health.
The Misunderstood Relationship Between Declining Mortality and Increasing Racial and Social Disparities in Mortality Rates James P. Scanlan (Presented.
The Link Between Childhood Adversity and Adult Health Risk Trajectories Andrea Willson Kim Shuey The University of Western Ontario.
2009 Joint Statistical Meetings Washington, DC August 1-6, 2009 Interpreting Differential Effects in Light of Fundamental Statistical Tendencies James.
Health Equity 101 An Introduction to Health Equity June 26, 2013.
Low-Quality, High-Cost Hospitals, Mainly in South, Care for Sharply Higher Shares of Elderly Black, Hispanic, and Medicaid Patients Ashish K. Jha, E. John.
Compare Outcomes Using all the above specific categories, we could compare 0-4 year-old male Asian mortality rates for asthma with 0-4 Asian female rates.
Chapter 9: Introduction to the t statistic
Agency for Healthcare Research and Quality Advancing Excellence in Health Care Trends in the.
Routine HIV Screening in Health Care Settings David Spach, MD Clinical Director Northwest AIDS Education and Training Center Professor of Medicine, Division.
Measuring Health and Healthcare Disparities 2013 Research Conference of the Federal Committee on Statistical Methodology Washington, DC, Nov. 4-6, 2013.
2007 National Healthcare Disparities Report (NHDR) Progress is being made, but many of the biggest gaps remain Released March 3, 2008.
Projecting Future Mortality Using Information on Health Behaviors David M. Cutler, Edward L. Glaeser, and Allison B. Rosen.
European Society of Cardiology Cardiovascular diseases in women.
2007 National Healthcare Quality Report (NHQR) Health care quality continues to improve, but the rate of improvement has slowed Released March 3, 2008.
Kansas Department of Health and Environment Center for Health Disparities 2008 Health Disparities Conference Topeka, Kansas, Apr. 1, 2008 Measuring Health.
I Caceres and B Cohen Division of Research and Epidemiology Bureau of Health Information, Statistics, Research and Evaluation Massachusetts Department.
Community Health Needs Assessment Introduction and Overview Berwood Yost Franklin & Marshall College.
“The African American Prostate Cancer Crisis in Numbers”
Writing the Scientific Paper Why you should write How to prepare to write Introduction Methods Results.
What do we know about overall trends in patient safety in the USA? Patrick S. Romano, MD MPH Professor of Medicine and Pediatrics University of California,
Source: Massachusetts Department of Public Health, Bureau of Health Information, Statistics, Research, and Evaluation Health Disparities in Massachusetts:
Healthcare Disparities in the Rural Population Amy Haines Michael Klein.
Conflicting Values for Evaluation: Effectiveness or Equity Louise Potvin Chair CHSRF/CIHR, Community Approaches and Health Inequalities, Université de.
Understanding Variations in Group Differences that are the Results of Variations in the Prevalence of an Outcome American Public Health Association 134.
16 th Nordic Demographic Symposium Helsinki, Finland, 5-7 June 2008 Measures of Health Inequalities that are Unaffected by the Prevalence of an Outcome.
Royal Statistical Society 2009 Conference Edinburgh, Scotland 7-11 September 2009 Measuring Health Inequalities by an Approach Unaffected by the Overall.
7 th International Conference on Health Policy Statistics, Philadelphia, PA, January 17-18, 2008 Can We Actually Measure Health Disparities? James P. Scanlan.
What is health equity? Module A. Sudbury District Health Video – Nadia’s story placeholder.
Measuring Racial and Ethnic Disparities in Health Insurance on the Eve of Health Care Reform: Using Health- and Insurance-specific Life Expectancies as.
INFANT MORTALITY & RACE Trends in the United States Introduction to Family Studies Group # 2 Jane Doe: John
Evaluating the Impact of Medicaid Managed Care on Preventive Health Care Use by Children and Adolescents June 24, 2006 Todd Eberly, Ph.D. Child Health.
Measuring Healthcare Disparities Third North American Congress of Epidemiology Montreal, Quebec, June 21-24, 2011 James P. Scanlan Attorney at Law Washington,
Health, United States: History, Uses, and Future Directions Health, US Over the Years: Diane Makuc Health, US in the 21 st Century: Amy Bernstein Media.
British Society for Population Studies 2007 Annual Conference St. Andrews, Scotland, Sep 2007 Methodological Issue in Comparing the Size of Differences.
Trends in Regionalization of Inpatient Care for Urological Malignancies Matthew R. Cooperberg Sanjukta Modak Badrinath R. Konety Department of Urology.
Poor Research Designs in Policy Impact Studies: “Lies, Damn Lies, and Statistics” AHRQ 2007 Annual Conference: Improving Healthcare, Improving Lives September.
Reducing Health Disparities Through Research & Translation Programs Francis D. Chesley, Jr., M.D. Francis D. Chesley, Jr., M.D. Director, Office of Extramural.
Medicaid and the 4 A’s: Use of 1115 Waivers and State Plan Amendments American Cancer Society Washington, Dc June 5, 2008 Erin Reidy
Stephen Nkansah-Amankra, PhD, MPH, MA 1, Abdoulaye Diedhiou, MD, PHD, H.L.K. Agbanu, MPhil, Curtis Harrod, MPH, Ashish Dhawan, MD, MSPH 1 University of.
Social Equity: Health and Healthcare Indicators Richard W. Hug Fifth Social Equity Leadership Conference Omaha, Nebraska February 2, 2006.
Trends in Colorectal Cancer Incidence Rates by Race, Age and Indices of Access to Medical Care in the U.S., Yongping Hao, PhD 1 Ahmedin Jemal,
Maternal and child health profile, Kansas City, Missouri,
Chronic Illness and Aging
DISCUSSION & CONCLUSIONS
Disparities in Chronic Disease Management and Prevention: Findings from the 2006 National Healthcare Quality Report Authors: Anika Hines, MPH; Karen Ho,
Mesfin S. Mulatu, Ph.D., M.P.H. The MayaTech Corporation
2014 Texas Pediatric Society Electronic Poster Contest
The Misinterpretation of Health Inequalities in the United Kingdom
The Misinterpretation of Health Inequalities in Nordic Countries
Lung cancer prevalence on the rise (Nov. 2014)
Colorectal Cancer Screening, Medicare and Disability
The Scope of the Problem
James P. Scanlan Attorney at Law Washington, DC, USA
PAD 505 Education for Service-- snaptutorial.com
PAD 505 Teaching Effectively-- snaptutorial.com
Chapter 1: CKD in the General Population
Health Inequalities.
James P. Scanlan Attorney at Law Washington, DC, USA
Increasing Disparity: The Scanlan Effect
9th International Conference on Health Policy Statistics
Receipt of Adjuvant Endometrial Cancer Treatment According to Race NRG Oncology/Gynecologic Oncology Group (GOG) 210 Study Ashley Felix, PhD, MPH Assistant.
Measuring Health Disparities in Healthy People 2010
Effect of intervention differed across racial and socioeconomic groups
Presentation transcript:

Measurement Problems in the National Healthcare Disparities Report American Public Health Association 135 th Annual Meeting & Exposition, Nov. 3-7,2007, Washington, DC James P. Scanlan Attorney at Law Washington, DC

National Healthcare Disparities Report (NHDR) of Agency for Healthcare Research and Quality (AHRQ) Yearly reports mandated by congress 4 reports issued ( ); 2007 forthcoming 2005 and 2006 measure disparity changes over time 2006 report: – 24 process quality core measures (e.g., prenatal care in first trimester) – 18 clinical outcome quality core measure (e.g., colorectal cancer) – 6 access core measures (e.g., insurance coverage) – For virtually all core measures the sizes of disparities are evaluated in terms of relative difference in rates of adverse outcomes (e.g., failure to receive prenatal care in first trimester, cancer rates, lack of insurance)

Key Measurement Problem in NHDR NHDR fails to recognize that all measures of differences between two groups’ rates of experiencing or avoiding some outcome tend to change in certain ways solely as a result of changes in the prevalence of the outcome. Without recognizing and attempting to account for these tendencies it is impossible to draw meaningful conclusions about changes in health or healthcare disparities over time. According to the approach in the NHDR, as healthcare improves, and favorable outcomes become more common (adverse outcomes become less common), healthcare disparities will be perceived to be increasing.

Patterns of Changes in Four Measures of Differences Between Rates as an Outcome Goes from Being Very Rare to Being Almost Universal Relative differences in experiencing the outcome tend to decrease. Relative differences in failing to experience the outcome tend to increase. Absolute differences initially increase then decline. Odds ratios initially decline then increase.

References jpscanlan.com – Measuring Health Disparities Tab (especially Section D) “Can We Actually Measure Health Disparities?” Chance 2006 “Measuring Health Disparities,” J Public Health Management and Practice 2006 “The Misinterpretation of Health Inequalities in the United Kingdom,” British Society for Population Studies Conference 2006 “Race and Mortality,” Society 2000

Specifications for Figures 1- 5 Two normal distributions of factors associated with risks of experiencing or avoiding some outcome (e.g., scores on a paper and pencil test) Mean of advantaged group (AG) is one half a standard deviation higher than mean of disadvantaged group (DG) Distributions have same standard deviation

Fig 1: Ratio of (1) AG Success Rate to DG Success Rate (Ratio a) at Various Cutoffs Defined by AG Success Rate

Fig 2: Ratios of (1) AG Success Rate to DG Success Rate (Ratio a) and (2) DG Fail Rate to AG Fail Rate (Ratio b)

Fig 3: Ratios of (1) AG Success Rate to DG Success Rate (Ratio a), (2) DG Fail Rate to AG Fail Rate (Ratio b), and (3) DG Fail Odds to AG Fails Odds

Fig 4: Ratios of (1) AG Success Rate to DG Success Rate (Ratio a), (2) DG Fail Rate to AG Fail Rate (Ratio b), and (3) DG Fail Odds to AG Fails Odds; and (4) Absolute Difference Between Rates

Fig 5: Absolute Difference Between Success (or Failure) Rates of AG and DG at Various Cutoffs

Other Illustrative Data Income data (Chance 2006) NHANES data (D41, BSPS 2007) Framingham calculator (do it yourself) Published test score/proficiency data

A Timely Illustration (from Sunday’s Washington Post) A Timely Illustration (from Sunday’s Washington Post) From a chart styled “Remarkable Results” in De Vise D. Closing the gap. Washington Post Nov. 4, 2007:1,12. Math Proficiency Rates at Rock View Elementary: Black53%81% White 81%97% Summary of changes: Absolute diff: decreased from 28 to 16 Relative diff in proficiency: decreased from 53% to 20% Relative diff in non-proficiency: increased from 147% to 530%

Two Contrasting Studies of Changes in Absolute Differences Between Black and White Rates as Favorable Outcome Becomes More Common Jha et al. Racial trends in the use of major procedures among the elderly. N Engl J Med 2005;353: – increasing overall rates of relatively uncommon outcomes – increasing absolute differences Trivedi et al. Trends in the quality of care and racial disparities in Medicare managed care. N Engl J Med 2005;353: – increasing overall rates of more common outcomes – decreasing absolute differences See D23, D40, D41

Illustration Based on Rates of Adequate Hemodialysis Sehgal AR. Impact of quality improvement efforts on race and sex disparities in hemodialysis. JAMA 2003;289: Found that as rates of adequate dialysis increased, absolute differences declined. Cited by AHRQ officials and others as showing how improving care reduces disparities. Under measurement approach in the NHDR, however, the disparities would be deemed to have increased. Rates of adequate dialysis White Black %36% %84% Summary of changes: Absolute diff: decreased from 10 to 3 Relative diff in adequate dialysis: decreased from 28% to 4% (cor. 3/12/08) Relative diff in inadequate dialysis: increased from 19% to 23%

Varied Implications of Measurement in Terms of Relative Differences in Adverse Outcome As healthcare and health improve, disparities will seem to increase. Most effective measures (even ones seemingly focused on the disadvantaged) will seem to increase disparities (see D3 re Back to Sleep Program). Disparities will seem to be largest in areas or among subpopulations where adverse outcomes are rarest (see Chance 2006, Society 2000, BSPS 2006, Nordic Conf. 2006, D16,17). Disparities tend to be largest with respect to adverse outcomes that are rarest (also pertinent to the National Healthcare Quality Report’s analyses of variance across states).

Which measure is best? None of the four measures discussed alone can indicate whether a change between rates is other than solely a consequence of changes in prevalence. Further, each measure can change in one direction even when there in fact is a meaningful change in the opposite direction. Be mindful that it is not always the favorable outcome that is increasing – and that as adverse outcomes increase, relative differences in those outcomes will tend to decline.

Can we actually measure health or healthcare disparities? Dichotomous variables while taking the described tendencies into account (Chance 2006, BSPS 2006) Continuous variables (BSPS 2006, Lisbon 2007*, JSM 2007) The problematic implications of changes in smoking prevalence (BSPS 2006) Different possibilities for measuring health outcome disparities and health process disparities