DECISION THEORY GOOD CAUSALITY BAD

Slides:



Advertisements
Similar presentations
CORRELATION. Overview of Correlation u What is a Correlation? u Correlation Coefficients u Coefficient of Determination u Test for Significance u Correlation.
Advertisements

Basic Experimental Design
Comments on Hierarchical models, and the need for Bayes Peter Green, University of Bristol, UK IWSM, Chania, July 2002.
Bayesian inference “Very much lies in the posterior distribution” Bayesian definition of sufficiency: A statistic T (x 1, …, x n ) is sufficient for 
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Omitted Variable Bias Methods of Economic Investigation Lecture 7 1.
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 13 Nonlinear and Multiple Regression.
PHSSR IG CyberSeminar Introductory Remarks Bryan Dowd Division of Health Policy and Management School of Public Health University of Minnesota.
Overview- Lecture 4 Research Methods Research Designs: Review of the Basics Developmental Research Designs Measurement Effects: Confounds Better Ways?
An Experimental Paradigm for Developing Dynamic Treatment Regimes S.A. Murphy Univ. of Michigan March, 2004.
10-1 Introduction 10-2 Inference for a Difference in Means of Two Normal Distributions, Variances Known Figure 10-1 Two independent populations.
Hypothesis Testing and Dynamic Treatment Regimes S.A. Murphy Schering-Plough Workshop May 2007 TexPoint fonts used in EMF. Read the TexPoint manual before.
Study Design Data. Types of studies Design of study determines whether: –an inference to the population can be made –causality can be inferred random.
Multivariate Data Analysis Chapter 4 – Multiple Regression.
An Experimental Paradigm for Developing Adaptive Treatment Strategies S.A. Murphy Univ. of Michigan February, 2004.
Statement of the Problem Goal Establishes Setting of the Problem hypothesis Additional information to comprehend fully the meaning of the problem scopedefinitionsassumptions.
Chapter 2 – Tools of Positive Analysis
TOOLS OF POSITIVE ANALYSIS
Introduction to the design (and analysis) of experiments James M. Curran Department of Statistics, University of Auckland
Jeff Howbert Introduction to Machine Learning Winter Classification Bayesian Classifiers.
Sampling Distributions  A statistic is random in value … it changes from sample to sample.  The probability distribution of a statistic is called a sampling.
Experimental Design The Gold Standard?.
Choosing Statistical Procedures
5-1 Introduction 5-2 Inference on the Means of Two Populations, Variances Known Assumptions.
1 1 Slide © 2005 Thomson/South-Western Chapter 13, Part A Analysis of Variance and Experimental Design n Introduction to Analysis of Variance n Analysis.
Chapter 14: Repeated-Measures Analysis of Variance.
EVAL 6970: Cost Analysis for Evaluation Dr. Chris L. S. Coryn Nick Saxton Fall 2014.
The Journey Of Adulthood, 5/e Helen L. Bee & Barbara R. Bjorklund Chapter 1 Defining the Journey: Some Assumptions, Definitions, and Methods The Journey.
Experimental Design making causal inferences Richard Lambert, Ph.D.
Techniques of research control: -Extraneous variables (confounding) are: The variables which could have an unwanted effect on the dependent variable under.
1 Chapter 13 Analysis of Variance. 2 Chapter Outline  An introduction to experimental design and analysis of variance  Analysis of Variance and the.
Various topics Petter Mostad Overview Epidemiology Study types / data types Econometrics Time series data More about sampling –Estimation.
Research Process Parts of the research study Parts of the research study Aim: purpose of the study Aim: purpose of the study Target population: group whose.
PowerPoint presentation to accompany Research Design Explained 6th edition ; ©2007 Mark Mitchell & Janina Jolley Chapter 10 The Simple Experiment.
Inference and Inferential Statistics Methods of Educational Research EDU 660.
Empirical Efficiency Maximization: Locally Efficient Covariate Adjustment in Randomized Experiments Daniel B. Rubin Joint work with Mark J. van der Laan.
Chapter 7 Sampling and Sampling Distributions ©. Simple Random Sample simple random sample Suppose that we want to select a sample of n objects from a.
What Does the Likelihood Principle Say About Statistical Process Control? Gemai Chen, University of Calgary Canada July 10, 2006.
Academic Research Academic Research Dr Kishor Bhanushali M
Single-Factor Studies KNNL – Chapter 16. Single-Factor Models Independent Variable can be qualitative or quantitative If Quantitative, we typically assume.
Linear Correlation. PSYC 6130, PROF. J. ELDER 2 Perfect Correlation 2 variables x and y are perfectly correlated if they are related by an affine transform.
1 Basic epidemiological study designs and its role in measuring disease exposure association M. A. Yushuf Sharker Assistant Scientist Center for Communicable.
Experimental Research Methods in Language Learning Chapter 5 Validity in Experimental Research.
INTRODUCTION TO STATISTICS. Anthony J Greene2 Lecture Outline I.The Idea of Science II.Experimental Designs A.Variables 1.Independent Variables 2.Dependent.
Stats 845 Applied Statistics. This Course will cover: 1.Regression –Non Linear Regression –Multiple Regression 2.Analysis of Variance and Experimental.
Axiomatic Theory of Probabilistic Decision Making under Risk Pavlo R. Blavatskyy University of Zurich April 21st, 2007.
AP Statistics Semester One Review Part 2 Chapters 4-6 Semester One Review Part 2 Chapters 4-6.
Africa Program for Education Impact Evaluation Dakar, Senegal December 15-19, 2008 Experimental Methods Muna Meky Economist Africa Impact Evaluation Initiative.
Assessing Responsiveness of Health Measurements Ian McDowell, INTA, Santiago, March 20, 2001.
Aim: What factors must we consider to make an experimental design?
Repetition I  Causes of biases in contingency and causal judgments:  Pattern recognition capabilities.  Belief in the law of small numbers.  Hot hand.
Hypothesis Testing. Statistical Inference – dealing with parameter and model uncertainty  Confidence Intervals (credible intervals)  Hypothesis Tests.
1/54 Statistics Analysis of Variance. 2/54 Statistics in practice Introduction to Analysis of Variance Analysis of Variance: Testing for the Equality.
Copyright © 2015 Inter-American Development Bank. This work is licensed under a Creative Commons IGO 3.0 Attribution-Non Commercial-No Derivatives (CC-IGO.
Experimental Evaluations Methods of Economic Investigation Lecture 4.
PH240A Epidemiology and the Curse of Dimensionality Alan Hubbard Division of Biostatistics U.C. Berkeley
Statistical Experiments What is Experimental Design.
Inference about the slope parameter and correlation
Statistical Modelling
Statistics Analysis of Variance.
Statistics for Business and Economics (13e)
Making Causal Inferences and Ruling out Rival Explanations
Statistical Assumptions for SLR
Propagation Algorithm in Bayesian Networks
RESEARCH METHODS Lecture 33
Positive analysis in public finance
Introduction to the design (and analysis) of experiments
Chapter 10 – Part II Analysis of Variance
Clinical prediction models
RESEARCH METHODS Lecture 33
Presentation transcript:

DECISION THEORY GOOD CAUSALITY BAD Philip Dawid University College London

Define/measure “the effect of treatment” A SIMPLE PROBLEM Randomised experiment Binary (0/1) treatment decision variable T Response variable Y Treatment could be more general Define/measure “the effect of treatment”

Statistical Model (Fisher) Specify/estimate conditional distributions Pt for Y given T = t (t = 0, 1) This is sufficient for optimal choice topt of T – choose to minimise expected loss Measure effect of treatment by appropriate comparison of distributions P0 and P1 – e.g. difference of expected responses Regular arrow = probabilistic dependence

Decision Tree Influence Diagram T Y L Y~P0 L(y) Y~P1 Y~Pt L(y) Y y T 1 1 y Y Y~P0 Y~P1 L(y) Influence Diagram T Y Y~Pt t L L(y)

Potential Response Model Split Y in two: Y0 : response to T = 0 Y1 : response to T = 1 counterfactual/ complementary Treatment “uncovers” pre-existing response: Y = YT (deterministic) Consider (for any unit) the pair Y = (Y0 , Y1) with simultaneous existence and joint distribution Unit-level (individual) [random] causal effect Tablets of stone Y1 - Y0 necessarily unobservable!

Potential Responses: Problems PR model: Corresponding statistical model: Can estimate \mu_t, \sigma^2 from expt. Equality of variances inessential. For structural model, \rho = 1, Y_1 – Y_0 = \mu_1 - \mu_0, non-random. This is TUA in PR model. NB: r does not enter! – can never identify r – does this matter??

Potential Responses: Problems Under PR model: depends on r We can not estimate a “ratio” ICE We can not identify the variance of the ICE We can not identify the (counterfactual) ICE after observing response to treatment

OBSERVATIONAL STUDY Treatment decision taken may be associated with patient’s state of health What assumptions are required to make causal inferences? When/how can such assumptions be justified?

Potential Response Model Y (e.g., bivariate normal) T Y (observational distribution) (determined) “Ignorable treatment assignment” – treatment independent of potential responses

“error” or “unit characteristics” Functional Model U “error” or “unit characteristics” T Y (determined) Same E as before. Why? “No confounding”: (treatment independent of “unit characteristics”)

Comments Value of Y = (Y0, Y1) on any unit implicitly supposed the same in observational and experimental regimes (as well as for both choices of T ) How are we to judge independence of T from Y ?

Statistical Decision Model Introduce explicit “treatment regime indicator” variable FT Values: FT = 0 : Assign treatment 0 ( T = 0) FT = 1 : Assign treatment 1 ( T = 1) FT =  : Just observe “Ignorable treatment assignment”: identity of observational and experimental distributions for Y | T :

(probabilistic, not functional, relationships) Influence Diagram (probabilistic, not functional, relationships) b FT T Y Absence of arrow b expresses

Cannot reverse arrow! FT T Y now expresses rather than

DYNAMIC TREATMENT REGIMES L1 L0 A0 A1 time observe act Consider (deterministic) treatment regime : Distribution of Y under ?

– if history to date consistent with , so is next observable PR Approach For each regime have potential intermediate and response variables: “Consistency”: Implies complex functional constraints between PRs: r.v.. L_{0g} indep. of g g(L_0) = h(L_0) implies L_{1g} = L_{1h} g(L_0) = h(L_0), g(L_1) = h(L_1) implies Y_{g} = Y_{h} – if history to date consistent with , so is next observable

“Sequential Ignorability” For each regime and all possible (l0, l1): – actions independent of future potential observables, given current (consistent) history – when valid, allows estimation of distribution of any from observational data – by “G-computation” formula

Decision Approach Introduce explicit “dynamic regime indicator” variable G Values include various (now possibly randomised) experimental regimes and observational regime 

Sequential Ignorability Conditional distribution of each observable, given history, is the same under all regimes:

Influence Diagram L0 A0 L1 A1 Y G

CONCLUSIONS Causal models based on potential responses incorporate untestable assumptions At best we are carrying dead wood At worst we can get different inferences for observationally equivalent models Standard probabilistic/ statistical/ decision-theoretic methods are clearer, more straightforward, and less prone to error

Further Reading Dawid, A. P. (2000). Causal inference without counterfactuals (with Discussion). J. Amer. Statist. Ass. 95, 407– 448. Dawid, A. P. (2002). Influence diagrams for causal modelling and inference. Intern. Statist. Rev. 70, 161– 189. Corrigenda, ibid., 437. Dawid, A. P. (2003). Causal inference using influence diagrams: The problem of partial compliance (with Discussion). In Highly Structured Stochastic Systems, edited by Peter J. Green, Nils L. Hjort and Sylvia Richardson. Oxford University Press, 45 – 81. Dawid, A. P. (2004). Probability, causality and the empirical world: A Bayes–de Finetti–Popper–Borel synthesis. Statistical Science 19, 44 – 57. Dawid, A. P. and Didelez, V. (2005). Identifying the consequences of dynamic treatment strategies. Research Report 262, Department of Statistical Science, University College London.