Applying Causal Inference Methods to Improve Identification of Health and Healthcare Disparities, and the Underlying Mediators and Moderators of Disparities.

Slides:



Advertisements
Similar presentations
Racial and Ethnic Disparities in Health and Health Care: Why the Gaps? Brian D. Smedley, Ph.D. The Opportunity Agenda.
Advertisements

A Socio Cultural Framework for Mental Health and Substance Abuse Service Disparities Research with Multicultural Populations Margarita Alegria, Ph.D. Glorisa.
The World Bank Human Development Network Spanish Impact Evaluation Fund.
Econometrics Session 1 – Introduction Amine Ouazad, Asst. Prof. of Economics.
1 Arlene Ash QMC - Third Tuesday September 21, 2010 (as amended, Sept 23) Analyzing Observational Data: Focus on Propensity Scores.
Social Factors Matter Class, Race and Gender in Health Outcomes.
Income and Child Development Lawrence Berger, University of Wisconsin Christina Paxson, Princeton University Jane Waldfogel, Columbia Univerity.
Unequal Treatment: Confronting Racial and Ethnic Disparities in Healthcare Institute of Medicine.
Explaining Race Differences in Student Behavior: The Relative Contribution of Student, Peer, and School Characteristics Clara G. Muschkin* and Audrey N.
Departments of Medicine and Biostatistics
Sensitivity Analysis for Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
Child Health Disparities Denice Cora-Bramble, MD, MBA Professor of Pediatrics, George Washington University Executive Director Goldberg Center for Community.
Occupational Segregation and Racial Health Disparities K Chung-Bridges, C Muntaner, LE Fleming, DJ Lee, KL Arheart, WG LeBlanc, AJ Caban Martinez, SL Christ,
1 Data and Analytic Approaches for Studies of Health and Health Care Disparities Alan M. Zaslavsky John Z. Ayanian Harvard Medical School.
1 Arlene Ash QMC - Third Tuesday September 21, 2010 Analyzing Observational Data: Focus on Propensity Scores.
Clustered or Multilevel Data
Health Disparities/ Cultural Competence Curriculum Clinical Addiction Research and Education Unit Section of General Internal Medicine Boston University.
Practical Meta-Analysis -- D. B. Wilson
TOOLS OF POSITIVE ANALYSIS
David Card, Carlos Dobkin, Nicole Maestas
The Economic Impact of Intensive Case Management on Costly Uninsured Patients in Emergency Departments: An Evaluation of New Mexico’s Care One Program.
Comparing high-dimensional propensity score versus lasso variable selection for confounding adjustment in a novel simulation framework Jessica Franklin.
Advanced Statistics for Interventional Cardiologists.
1 Is Managed Care Superior to Traditional Fee-For-Service among HIV-Infected Beneficiaries of Medicaid? David Zingmond, MD, PhD UCLA Division of General.
Measuring Output from Primary Medical Care, with Quality Adjustment Workshop on measuring Education and Health Volume Output OECD, Paris 6-7 June 2007.
EVAL 6970: Cost Analysis for Evaluation Dr. Chris L. S. Coryn Nick Saxton Fall 2014.
Disparities in the Adequacy of Depression Treatment in the United States Jeffrey S. Harman, Ph.D. University of Florida Mark J. Edlund, M.D., Ph.D. John.
Potential Sources of Racial and Ethnic Healthcare Disparities – Healthcare Systems- level Factors Cultural and linguistic barriers – many non- English.
Why is Cultural Competency Important in the Practice of Medicine? Karen E. Schetzina, MD, MPH.
Slide 1 Estimating Performance Below the National Level Applying Simulation Methods to TIMSS Fourth Annual IES Research Conference Dan Sherman, Ph.D. American.
Achieving Health Equity: The importance of academic medical centers Harold M. Szerlip, MD, FACP, FCCP, FASN, FNKF Professor, Department of Medicine Internal.
Health Disparities and Multicultural Practice Clarence H. Braddock III, MD, MPH, FACP Associate Professor of Medicine Associate Dean, Medical Education.
1 Measurement Challenges in Reducing Disparities in Health Care Sheldon Greenfield, MD Executive Director University of California, Irvine Center for Health.
Introduction to confounding and DAGs
Exploring The Determinants Of Racial & Ethnic Disparities In Total Knee Arthroplasty: Health Insurance, Income And Assets Amresh Hanchate, PhD Health Care.
CAUSAL INFERENCE Shwetlena Sabarwal Africa Program for Education Impact Evaluation Accra, Ghana, May 2010.
Article Review Cara Carty 09-Mar-06. “Confounding by indication in non-experimental evaluation of vaccine effectiveness: the example of prevention of.
The Price of Violence Long term effects of assault on labor force participation and health Petra Ornstein, Uppsala university.
Estimating Causal Effects from Large Data Sets Using Propensity Scores Hal V. Barron, MD TICR 5/06.
ECON 3039 Labor Economics By Elliott Fan Economics, NTU Elliott Fan: Labor 2015 Fall Lecture 21.
Propensity Score Matching for Causal Inference: Possibilities, Limitations, and an Example sean f. reardon MAPSS colloquium March 6, 2007.
The Health Consequences of Incarceration Michael Massoglia Penn State University.
Public Policy Analysis ECON 3386 Anant Nyshadham.
Obesity, Medication Use and Expenditures among Nonelderly Adults with Asthma Eric M. Sarpong AHRQ Conference September 10, 2012.
Racial/Ethnic Disparities in Quality of Ambulatory Care for Chronic Physical Health Conditions: T he effects of physician and care setting characteristics.
Generalizing Observational Study Results Applying Propensity Score Methods to Complex Surveys Megan Schuler Eva DuGoff Elizabeth Stuart National Conference.
New Measures of Data Utility Mi-Ja Woo National Institute of Statistical Sciences.
Social Factors Matter Class, Race and Gender in Health Outcomes.
1 Multivariable Modeling. 2 nAdjustment by statistical model for the relationships of predictors to the outcome. nRepresents the frequency or magnitude.
Overview of Regression Analysis. Conditional Mean We all know what a mean or average is. E.g. The mean annual earnings for year old working males.
Term 4, 2006BIO656--Multilevel Models 1 PART 07 Evaluating Hospital Performance.
Hospital racial segregation and racial disparity in mortality after injury Melanie Arthur University of Alaska Fairbanks.
Regression Analysis: Part 2 Inference Dummies / Interactions Multicollinearity / Heteroscedasticity Residual Analysis / Outliers.
Using Propensity Score Matching in Observational Services Research Neal Wallace, Ph.D. Portland State University February
Explaining Racial and Ethnic Differences in Children’s Use of Stimulant Medications J.L. Hudson G.E. Miller J.B. Kirby September 8, 2008.
Defining and measuring disparities, inequities, and inequalities in the Healthy People initiative Richard Klein MPH, David Huang, Ph.D. National Center.
Randomized Assignment Difference-in-Differences
Impact of Perceived Discrimination on Use of Preventive Health Services Amal Trivedi, M.D., M.P.H. John Z. Ayanian, M.D., M.P.P. Harvard Medical School/Brigham.
The measurement and comparison of health system responsiveness Nigel Rice, Silvana Robone, Peter C. Smith Centre for Health Economics, University of York.
Todd Wagner, PhD February 2011 Propensity Scores.
The Impact of Cost Sharing on Middle-Income Children AcademyHealth Annual Research Meeting June 2008 Amy M Lischko.
6. Ordered Choice Models. Ordered Choices Ordered Discrete Outcomes E.g.: Taste test, credit rating, course grade, preference scale Underlying random.
[Part 5] 1/43 Discrete Choice Modeling Ordered Choice Models Discrete Choice Modeling William Greene Stern School of Business New York University 0Introduction.
(ARM 2004) 1 INNOVATIVE STATISTICAL APPROACHES IN HSR: BAYESIAN, MULTIPLE INFORMANTS, & PROPENSITY SCORES Thomas R. Belin, UCLA.
Co-occurring Mental Illness and Healthcare Utilization and Expenditures Among Adults with Obesity and Chronic Physical Illness Chan Shen, MA. MS. Usha.
Research and Evaluation Methodology Program College of Education A comparison of methods for imputation of missing covariate data prior to propensity score.
Measuring Results and Impact Evaluation: From Promises into Evidence
Jennie J Kronenfeld. PhD Arizona State University
University of Massachusetts Medical School
Counterfactual models Time dependent confounding
Presentation transcript:

Applying Causal Inference Methods to Improve Identification of Health and Healthcare Disparities, and the Underlying Mediators and Moderators of Disparities December 10, 2015

Overview Identifying healthcare disparities: applying concepts from a causal inference framework (Cook) Brief background on race and causal inference A framework that uses the notion of the “counterfactual” to measure healthcare disparities. Identifying Pathways Amenable to Disparities Reduction (Valeri) A causal inference perspective Example of racial disparities in cancer survival 2

Identifying Health Disparities and Pathways Amenable for Interventions to Reduce Disparities 3

4

5

Quantifying Disparities and How They Arise Jones CP et al. J Health Care Poor Underserved

Using counterfactual methods in disparities studies α= E(Y | X=x 1 ) - E(Y | X=x 2 ) 7 Dabady, M., Blank, R. M., & Citro, C. F. (Eds.). (2004). Measuring racial discrimination. National Academies Press. Holland 1986; 2003; Rubin 1974, 1977, 1978; Pearl The causal effect α is a difference in outcome Y between treatment (X=x1)and control (X=x2) Difference between an individual receiving treatment and the same individual not receiving treatment. Because the individual can only take one of these values, one of these is a counterfactual.

Using counterfactual methods in disparities studies α= E(Y | X=x 1 ) - E(Y | X=x 2 ) 8 X Z U Y X Z U Y Randomization Dabady, M., Blank, R. M., & Citro, C. F. (Eds.). (2004). Measuring racial discrimination. National Academies Press. Holland 1986; 2003; Rubin 1974, 1977, 1978; Pearl The causal effect α is a difference in outcome Y between treatment (X=x1)and control (X=x2) Randomized experiments and quasi-experiments at the population level allow us to calculate average treatment effects that estimate this causal effect.

Using counterfactual methods in disparities studies α= E(Y | X=x 1 ) - E(Y | X=x 2 ) 9 X Z U Y X Z U Y Randomization Randomization breaks the link between X and all other observables (Z) and unobserved variables (U) except the outcome (Y) By randomizing at the population level, we are able to infer the difference between the outcome if an individual received the treatment and the outcome if the same individual did not receive the treatment. Remember that one of these is a counterfactual. Dabady, M., Blank, R. M., & Citro, C. F. (Eds.). (2004). Measuring racial discrimination. National Academies Press. Holland 1986; 2003; Rubin 1974, 1977, 1978; Pearl The causal effect α is a difference in outcome Y between treatment (X=x1)and control (X=x2)

Using counterfactual methods disparities studies 10 VanderWeele, T. J., & Robinson, W. R. (2014). On the causal interpretation of race in regressions adjusting for confounding and mediating variables.Epidemiology, 25(4), see Krieger letter to editor and response.  For causation to occur, manipulability of the potential causal variable is required (Holland 2003)  Is race manipulable?  “Racial categories, differential perceptions and treatment of racial groups, and associations between race and health outcomes are modifiable.” Race??? Z U Y Randomization

11  In disparities studies, minority race is the “treatment” of interest.  Ideally, the counterfactual group is a group identical in all aspects to the minority group except for minority race status.  “Balancing” can be achieved (i.e., videos with actors (Schulman 1999), job applications given names typical of blacks and whites ( Bertrand and Mullainathan 2004 )).  Implementing the IOM definition of healthcare disparities requires a hypothetical group with counterfactual distributions of health status variables (Cook et al. 2009)… Using counterfactual methods to improve identification of healthcare disparities

Measuring healthcare disparities: A non-causal “counterfactual” problem 12 Institute of Medicine, 2003  Unequal Treatment defines disparities: “all differences except those due to clinical appropriateness and need and patient preferences”  Disparities do include differences due to SES (differential impact of healthcare systems and the legal/ regulatory climate), and discrimination.  In short, a comparison between whites and counterfactual group of blacks with white health status

Defining Healthcare Disparity: Differences, Discrimination, and Disparity 13 Quality of care Whites Blacks Difference Clinical Need & Appropriateness & Patient Preferences Healthcare Systems & Legal / Regulatory Systems Discrimination: Bias, Stereotyping, and Uncertainty The difference is due to: Disparity IOM Unequal Treatment 2002

Income Education Rates of Substance Use Age Geography Discrimination Racism Insurance Employment Comorbidities Should differences due to all of these factors be considered a disparity? 14 Are these allowable or justified differences? Should the health care system be held accountable for these differences in care? To track progress in a way that is useful for policy, do we count all these differences? Differences due to:

In Unequal Treatment, the IOM made a distinction between allowable and unallowable differences Allowable / Justified Need for Care (Substance abuse rates) Prevalence of MI Preferences for Care Unallowable / Unfair Discrimination Income Education Employment Insurance 15

Definition of Racial Disparities: IOM  Example 1: Difference overestimates disparity Hispanics are on average younger and therefore use less medical care. This is not an “unfair” difference.  Example 2: Difference underestimates disparity African-Americans are on average less healthy than Whites but may have very similar rates of utilization. If Blacks were made to be as healthy as Whites, we would see much less use for Blacks compared to Whites - an “unfair” difference.

Commonly Used Disparities Methods  Typical method of measuring disparities using a regression framework from previous studies 1) y=  0 +  R RACE i +  A Age i +  G Gender i +ε 2) y=  0 +  R RACE i +  A Age i +  G Gender i +  H Health i +ε 3) y=  0 +  R RACE i +  A Age i +  G Gender i +  H Health i +  I Income i +ε  Omitted variable bias -  R difficult to interpret  Difficult to track this coefficient (or change in coefficient) over time and across studies

Operationalizing the IOM Definition (1) Fit a model (2) Transform distribution of health status (not SES) (3) Calculate predictions for minorities with transformed health status - Average predictions by group and estimate disparities

Implementing the IOM Definition Adjust for health status (clinical appropriateness/ need), but not SES variables (system level variables) In a regression framework: y=  0 +  R RACE i +  H Health i +  S SES i +ε White: y W =  0 +  R RACE White +  H Health White +  S SES White +ε Black: y B =  0 +  R RACE Black +  H Health White +  S SES Black +ε Disparity: y W -y B ^^

Example: Fit a Model of MH Care Expenditures Two-part model Access (Expenditure>0): Probit Prob(y>0) = Ф(x'β) Expenditures: GLM with quasi-likelihoods E(y|x) = μ(x'β) and Var(y|x) = (μ(x'β)) λ with log link function and variance proportional to mean (λ=1) 1. Fit a model 2. Transform HS distribution 3. Calculate predictions

Adjust Need (HS) “Index” (Rank and Replace) 1. Fit a model 2. Transform HS distribution 3. Calculate predictions 100 White Black

Transform Distribution of Health Status 1. Fit a model 2. Transform HS distribution 3. Calculate predictions

 Weight each individual on the propensity of “being white” conditional on a vector of observed health status covariates. Measure P(White)=β 0 + β 1 (HS)+ε = ê (H i )  Weight minority individuals by their probability to be White (ê(H i )), and White individuals by their probability to be minority (1- ê(H i )).  Multiply PS weights by survey weights Conditional on the propensity score, the distributions of observed health status covariates are the same for minorities and Whites (Rubin 1997)  Places more emphasis on individuals with ê(H i ) close to 0.5, whose health status distributions could be either White or Black. Propensity Score Weighting 1. Fit a model 2. Transform HS distribution 3. Calculate predictions

Propensity Score Weighting P(White)=β 0 + β 1 (HS) = ê i (z) 1. Fit a model 2. Transform HS distribution 3. Calculate predictions Before PS weighting After PS weighting

Does the method matter? 25 Different estimates, similar variance

26 Different estimates for linear models Similar estimates for IOM concordant methods Does the method matter?

Summary  Counterfactual: “What would the rates of healthcare access be for a group of Black individuals with a white distribution of health status?”  IOM-concordant methods adjust for health status (but not SES) in the presence of non-linear models and correlations between health status and SES. Similar to non-linear decomposition (Fairlie 2006) and can be used to “decompose disparities” (Saloner, Carson, Cook 2014)  The rank and replace method and the modified propensity score method are “IOM-concordant” Both methods had similar estimates and variance in separate empirical analyses. 27

Summary 2:1 disparities in access to mental health care Applicable in the context of measuring readmissions and accountable care organizations that incentivize health disparity reduction? In disparities measurement, make a choice about how to define disparity; What is the right counterfactual comparison group? A race coefficient may be insufficient

@cmmhr SAS and Stata code available for the “rank and replace” adjustment of health status variables. 29