Confounding of indirect effects in the "real world" Danella Hafeman.

Slides:



Advertisements
Similar presentations
Comparator Selection in Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
Advertisements

Conclusion Epidemiology and what matters most
Understanding Statistics in Research Articles Elizabeth Crabtree, MPH, PhD (c) Director of Evidence-Based Practice, Quality Management Assistant Professor,
Where is Epidemiology going? Jan P Vandenbroucke Bern, STROBE meeting August 2010 Part II.
1 Case-Control Study Design Two groups are selected, one of people with the disease (cases), and the other of people with the same general characteristics.
Sensitivity Analysis for Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
Introduction to Cancer Epidemiology Epidemiology and Molecular Pathology of Cancer: Bootcamp course Tuesday, 3 January 2012.
Chance, bias and confounding
Measures of Disease Association Measuring occurrence of new outcome events can be an aim by itself, but usually we want to look at the relationship between.
Intermediate methods in observational epidemiology 2008 Confounding - II.
Measures of association
Comunicación y Gerencia 1Case control studies15/12/2010.
Hein Stigum courses E8 DAGs intro 2h, Answers Hein Stigum courses 17. apr. H.S.
Intermediate methods in observational epidemiology 2008 Confounding - I.
By Dr. Ahmed Mostafa Assist. Prof. of anesthesia & I.C.U. Evidence-based medicine.
THREE CONCEPTS ABOUT THE RELATIONSHIPS OF VARIABLES IN RESEARCH
BC Jung A Brief Introduction to Epidemiology - X (Epidemiologic Research Designs: Cohort Studies) Betty C. Jung, RN, MPH, CHES.
Thomas Songer, PhD with acknowledgment to several slides provided by M Rahbar and Moataza Mahmoud Abdel Wahab Introduction to Research Methods In the Internet.
EPIDEMIOLOGY Why is it so damn confusing?. Disease or Outcome Exposure ab cd n.
STrengthening the Reporting of OBservational Studies in Epidemiology
INTRODUCTION TO EPIDEMIOLO FOR POME 105. Lesson 3: R H THEKISO:SENIOR PAT TIME LECTURER INE OF PRESENTATION 1.Epidemiologic measures of association 2.Study.
Concepts of Interaction Matthew Fox Advanced Epi.
Measuring Associations Between Exposure and Outcomes.
Identify and List… Theory behind the study Aim of study.
Research Study Design and Analysis for Cardiologists Nathan D. Wong, PhD, FACC.
Biostatistics Case Studies 2005 Peter D. Christenson Biostatistician Session 4: Taking Risks and Playing the Odds: OR vs.
TWO-STAGE CASE-CONTROL STUDIES USING EXPOSURE ESTIMATES FROM A GEOGRAPHICAL INFORMATION SYSTEM Jonas Björk 1 & Ulf Strömberg 2 1 Competence Center for.
Lecture 17 (Oct 28,2004)1 Lecture 17: Prevention of bias in RCTs Statistical/analytic issues in RCTs –Measures of effect –Precision/hypothesis testing.
CHP400: Community Health Program- lI Research Methodology STUDY DESIGNS Observational / Analytical Studies Case Control Studies Present: Disease Past:
Web of Causation; Exposure and Disease Outcomes Thomas Songer, PhD Basic Epidemiology South Asian Cardiovascular Research Methodology Workshop.
Lecture 6 Objective 16. Describe the elements of design of observational studies: (current) cohort studies (longitudinal studies). Discuss the advantages.
 Is there a comparison? ◦ Are the groups really comparable?  Are the differences being reported real? ◦ Are they worth reporting? ◦ How much confidence.
Measures of Association
CAT 3 Harm, Causation Maribeth Chitkara, MD Rachel Boykan, MD.
Approaches to the measurement of excess risk 1. Ratio of RISKS 2. Difference in RISKS: –(risk in Exposed)-(risk in Non-Exposed) Risk in Exposed Risk in.
Design and Analysis of Clinical Study 2. Bias and Confounders Dr. Tuan V. Nguyen Garvan Institute of Medical Research Sydney, Australia.
S. Mazloomzadeh MD, PhD COHORT STUDIES Learning Objectives To develop an understanding of: - What is a cohort study? - What types of cohort studies are.
Clinical Trials: Introduction from an Epidemiologic Study Design Perspective Health Sciences Center Health Sciences Center School of Public Health & Stanley.
Chapter 2 Nature of the evidence. Chapter overview Introduction What is epidemiology? Measuring physical activity and fitness in population studies Laboratory-based.
Research Methods in Health Psychology Chapter 2. Science Science is not a thing in and of itself. It is a set of methods used to understand natural phenomena.
1 EPI 5240: Introduction to Epidemiology Measures used to compare groups October 5, 2009 Dr. N. Birkett, Department of Epidemiology & Community Medicine,
Unit 2 – Public Health Epidemiology Chapter 4 – Epidemiology: The Basic Science of Public Health.
Interpreting observational studies of cardiovascular risk of NSAIDs. Richard Platt, MD, MS Harvard Medical School and Harvard Pilgrim Health Care HMO Research.
Causation and association Dr. Salwa Tayel Family and Community Medicine Department King Saud University.
WHO GUIDANCE FOR THE DEVELOPMENT OF EVIDENCE-BASED VACCINE RELATED RECOMMENDATIONS August 2011.
Lipids Standardization and DAGs Enrique Schisterman, PhD Epidemiology Branch – DESPR – NICHD 1.
Case-Control Studies Abdualziz BinSaeed. Case-Control Studies Type of analytic study Unit of observation and analysis: Individual (not group)
Matching. Objectives Discuss methods of matching Discuss advantages and disadvantages of matching Discuss applications of matching Confounding residual.
Design of Clinical Research Studies ASAP Session by: Robert McCarter, ScD Dir. Biostatistics and Informatics, CNMC
Epidemiological Study Designs
Types of Studies. Aim of epidemiological studies To determine distribution of disease To examine determinants of a disease To judge whether a given exposure.
Measures of disease frequency Simon Thornley. Measures of Effect and Disease Frequency Aims – To define and describe the uses of common epidemiological.
Challenges to the Epidemiology of Aging: The REasons for Geographic And Racial Differences in Stroke Study George Howard, DrPH UAB School of Public Health.
Validity in epidemiological research Deepti Gurdasani.
Systematic review of the potential adverse effects of caffeine consumption in healthy adults, pregnant women, adolescents, and children: Cardiovascular.
Present: Disease Past: Exposure
Comparison of three Observational Analytical strategies
بسم الله الرحمن الرحيم COHORT STUDIES.
Characteristics of the Folic Acid and Placebo Groups at the Start of the Study J. Durga et al. Arch Intern Med. 2005;165:
A Meta-Analysis of Randomized Controlled Trials and Prospective Cohort Studies of Eicosapentaenoic and Docosahexaenoic Long-Chain Omega-3 Fatty Acids.
Random error, Confidence intervals and P-values
A Meta-Analysis of Randomized Controlled Trials and Prospective Cohort Studies of Eicosapentaenoic and Docosahexaenoic Long-Chain Omega-3 Fatty Acids.
Interpreting Basic Statistics
Nat. Rev. Cardiol. doi: /nrcardio
Evaluating Effect Measure Modification
Challenges in Interpreting Multivariable Mendelian Randomization: Might “Good Cholesterol” Be Good After All?  Michael V. Holmes, George Davey Smith 
Dr Luis E Cuevas – LSTM Julia Critchley
Baseline characteristics of the 1,842 men without coronary heart disease and the 230 men with a first coronary heart disease event during the 13-year.
Risk Ratio A risk ratio, or relative risk, compares the risk of some health-related event such as disease or death in two groups. The two groups are typically.
Presentation transcript:

Confounding of indirect effects in the "real world" Danella Hafeman

What is an indirect effect? Main Effect: Pathways that explain the main effect: Exposure (X) Disease (Y) Mediator (M) Exposure (X)Disease (Y) Indirect Effect

Confounding of the mediator Biases the indirect and direct effects, but not the main effect Problematic even when exposure (X) is randomized Mediator (M) Exposure (X)Disease (Y) Confounder (C) ??

“Real world” impact of confounding? A confounder of the mediator can cause bias (e.g. Cole and Hernan 2002) But how much bias? How much confounding would it take to explain the observed indirect effect?? “There is an urgent need for further methodological research that determines the likely magnitude and direction of bias in the estimation of direct and indirect effects” (Blakely 2002)

Study Aims Question: How much of a threat does confounding of the mediator pose under “real world” circumstances? Basic Approach: –Develop sensitivity analysis program –Re-assess results from two well-known mediation studies

Methods: Sensitivity Analysis Inputs Outputs

Inputs: Observed Risks Risk of the Mediator … in the unexposed: M0 … in the exposed: M1 Risk of Disease … in the unexposed, mediator-negative: Y00 … in the exposed, mediator-negative: Y10 … in the unexposed, mediator-positive: Y01 … in the exposed, mediator-positive: Y11

Inputs: Confounder Characteristics Confounder Prevalence –Range of possible confounder prevalences tested –P(C=1) =.01,.2,.4,.8 How much does the confounder interact with the exposure and the mediator? –No synergy –Perfect additivity –Perfect multiplicativity –Complete synergy

Main Effect = Y1 – Y0 Indirect Effect Proportion Explained = Indirect Effect/Main Effect Outputs: Observed Effects Pure Indirect Effect (PIE) = (M1-M0) x (Y01-Y00) X on M M on Y

Outputs: True Indirect Effects For each possible confounding scenario… Confounder Prevalence Interaction Model Confounder-mediator risk ratio Confounder-disease risk ratio … determine true indirect effect consistent with observed results Which confounding scenarios would change our interpretation of observed results?

Example 1: CHD (Freedman et al. 1992) Cholysteramine↓ Coronary Heart Disease (CHD) ↓ Serum Cholesterol Cholysteramine↓ CHD ↑ Serum Cholesterol (M) Placebo (X)↑ CHD (Y) Mediation Analysis Recode

CHD Example: Observed Risks and Effects Observed Risks Observed Effects XM0M1Y00Y01Y10Y Main EffectIndirect Effect (PIE)Proportion Explained %

CHD Example: True Indirect Effects Question: Could confounding plausibly explain the observed indirect effect? Answer: Yes Question: How strong would such a confounder have to be? Answer: It depends on… Confounder Prevalence Interaction Model

RR CM =5 RR CY =2.1 Confounder Prevalence C=.2 C=.8 No Synergy

Example 2: Vision Loss (Buyse & Mohlenbergs 1998) Interferon-αVision 12 mo. Vision 6 mo. (M) Interferon-α (X) Mediation Analysis Vision 12 mo. (Y)

Vision Loss Example: Observed Risks and Effects Observed Risks Observed Effects XM0M1Y00Y01Y10Y Main EffectIndirect Effect (PIE)Proportion Explained %

Vision Loss Example: True Indirect Effects Question: Could confounding plausibly explain the observed indirect effect? Answer: Only under very limited conditions… Interaction model (No synergy, perfect additivity) Confounder prevalence (C=.4) Strong risk ratios (>10)

RR CM =5 RR CY =2.3 Comparison: CHD vs. Vision Loss (1) Vision Loss No Synergy C=.4 CHD RR CM =20 RR CY =12.3

RR CM =5 RR CY =2.1 No Synergy C=.2 Comparison: CHD vs. Vision Loss (2) CHD Vision Loss

Results: Summary CHD Example –Confounding is a plausible alternative explanation (e.g. G=.2, RR CM =5, RR CY =2.5) –Note: Main effect even more vulnerable to confounding (e.g. G=.2, RR CX =2, RR CY =2) Vision Loss Example –Confounding is not a plausible alternative explanation (e.g. G=.4, RR CM =20, RR CY =12.3)

Conclusions Assessment of mediation is not hopeless Main effect more vulnerable to confounding than the indirect effect Confounding represents a viable alternative explanation in some situations, but not others Investigators should consider the role that confounding might play in their assessment of mediation

Acknowledgements Sharon Schwartz Ezra Susser Medical Scientist Training Program