1 CONFOUNDING EQUIVALENCE Judea Pearl – UCLA, USA Azaria Paz – Technion, Israel (www.cs.ucla.edu/~judea/)

Slides:



Advertisements
Similar presentations
Department of Computer Science
Advertisements

Graphical Models BRML Chapter 4 1. the zoo of graphical models Markov networks Belief networks Chain graphs (Belief and Markov ) Factor graphs =>they.
Weakening the Causal Faithfulness Assumption
Outline 1)Motivation 2)Representing/Modeling Causal Systems 3)Estimation and Updating 4)Model Search 5)Linear Latent Variable Models 6)Case Study: fMRI.
CS Department Fireside Chat All are welcome! Wed Nov 18, 5-6pm, Ols 228e/236d Kim Hazelwood and Wes Weimer Meet and ask them questions in a non-academic.
1 WHAT'S NEW IN CAUSAL INFERENCE: From Propensity Scores And Mediation To External Validity Judea Pearl University of California Los Angeles (
1 NP-Complete Problems. 2 We discuss some hard problems:  how hard? (computational complexity)  what makes them hard?  any solutions? Definitions 
CAUSES AND COUNTERFACTUALS Judea Pearl University of California Los Angeles (
1 THE SYMBIOTIC APPROACH TO CAUSAL INFERENCE Judea Pearl University of California Los Angeles (
Chapter 8-3 Markov Random Fields 1. Topics 1. Introduction 1. Undirected Graphical Models 2. Terminology 2. Conditional Independence 3. Factorization.
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Technion 1 Generating minimum transitivity constraints in P-time for deciding Equality Logic Ofer Strichman and Mirron Rozanov Technion, Haifa, Israel.
Lights-Out on Graphs Nadav Azaria. What is “ Lights-Out ” ? “ Lights-Out ” is a hand- held electronic game by Tiger electronics. It is played on a 5 ‰
Technion 1 (Yet another) decision procedure for Equality Logic Ofer Strichman and Orly Meir Technion.
Chapter 11 Limitations of Algorithm Power Copyright © 2007 Pearson Addison-Wesley. All rights reserved.
C82MCP Diploma Statistics School of Psychology University of Nottingham 1 Overview of Lecture Independent and Dependent Variables Between and Within Designs.
Causal Models, Learning Algorithms and their Application to Performance Modeling Jan Lemeire Parallel Systems lab November 15 th 2006.
Causal Modeling for Anomaly Detection Andrew Arnold Machine Learning Department, Carnegie Mellon University Summer Project with Naoki Abe Predictive Modeling.
SIMPSON’S PARADOX, ACTIONS, DECISIONS, AND FREE WILL Judea Pearl UCLA
1 WHAT'S NEW IN CAUSAL INFERENCE: From Propensity Scores And Mediation To External Validity Judea Pearl University of California Los Angeles (
Mohammed Nasser Acknowledgement: Steve Cunningham
1 REASONING WITH CAUSES AND COUNTERFACTUALS Judea Pearl UCLA (
Chapter 1: Introduction to Statistics
Judea Pearl Computer Science Department UCLA DIRECT AND INDIRECT EFFECTS.
MCS312: NP-completeness and Approximation Algorithms
Analyzing Reliability and Validity in Outcomes Assessment (Part 1) Robert W. Lingard and Deborah K. van Alphen California State University, Northridge.
Judea Pearl University of California Los Angeles ( THE MATHEMATICS OF CAUSE AND EFFECT.
Krakow, Summer 2011 Comparability Graphs William T. Trotter
Chapter 5 General Vector Spaces.
Section 4.1 Vectors in ℝ n. ℝ n Vectors Vector addition Scalar multiplication.
Chapter 3 Vector Spaces. The operations of addition and scalar multiplication are used in many contexts in mathematics. Regardless of the context, however,
Lesson 4-1 Polynomial Functions.
Why is Research Important?. Basic Research Pure science or research Research for the sake of finding new information and expanding the knowledge base.
2.4 Irreducible Matrices. Reducible is reducible if there is a permutation P such that where A 11 and A 22 are square matrices each of size at least one;
1 Design and Analysis of Algorithms Yoram Moses Lecture 11 June 3, 2010
1 Bayesian Networks (Directed Acyclic Graphical Models) The situation of a bell that rings whenever the outcome of two coins are equal can not be well.
Design and Analysis of Algorithms - Chapter 101 Our old list of problems b Sorting b Searching b Shortest paths in a graph b Minimum spanning tree b Primality.
THE MATHEMATICS OF CAUSE AND COUNTERFACTUALS Judea Pearl University of California Los Angeles (
Collection of Data Jim Bohan
Graphing linear Inequalities in 2 Variables. Checking Solutions An ordered pair (x,y) is a solution if it makes the inequality true. Are the following.
CPSC 536N Sparse Approximations Winter 2013 Lecture 1 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAAAAAAA.
Judea Pearl Computer Science Department UCLA ROBUSTNESS OF CAUSAL CLAIMS.
CAUSAL REASONING FOR DECISION AIDING SYSTEMS COGNITIVE SYSTEMS LABORATORY UCLA Judea Pearl, Mark Hopkins, Blai Bonet, Chen Avin, Ilya Shpitser.
NPC.
Graphing a Two Variable Inequality. Examining the Solutions of a Linear Equation Are the following points solutions to the equation y = -2x + 3 ? Justify.
Mediation: The Causal Inference Approach David A. Kenny.
1 BN Semantics 2 – Representation Theorem The revenge of d-separation Graphical Models – Carlos Guestrin Carnegie Mellon University September 17.
Chapter 3 Polynomial and Rational Functions Copyright © 2014, 2010, 2007 Pearson Education, Inc Polynomial and Rational Inequalities.
Introduction to NP Instructor: Neelima Gupta 1.
1 Collecting and Interpreting Quantitative Data Deborah K. van Alphen and Robert W. Lingard California State University, Northridge.
1 Day 2: Search June 9, 2015 Carnegie Mellon University Center for Causal Discovery.
Ten things about Experimental Design AP Statistics, Second Semester Review.
Matrix Operations McDougal Littell Algebra 2 Larson, Boswell, Kanold, Stiff Larson, Boswell, Kanold, Stiff Algebra 2: Applications, Equations, Graphs Algebra.
On the Optimality of the Simple Bayesian Classifier under Zero-One Loss Pedro Domingos, Michael Pazzani Presented by Lu Ren Oct. 1, 2007.
1 Day 2: Search June 14, 2016 Carnegie Mellon University Center for Causal Discovery.
Chapter 10 NP-Complete Problems.
Stats/Methods II JEOPARDY.
University of California
Markov Properties of Directed Acyclic Graphs
Independence in Markov Networks
Markov Networks Independencies Representation Probabilistic Graphical
2.6 Graphing linear Inequalities in 2 Variables
Bayesian Networks Independencies Representation Probabilistic
Independence in Markov Networks
Copyright © 2014, 2010, 2007 Pearson Education, Inc.
Markov Networks Independencies Representation Probabilistic Graphical
Independence in Markov Networks
Markov Networks Independencies Representation Probabilistic Graphical
Graphing Linear Inequalities in 2 Variables
Collecting and Interpreting Quantitative Data
Presentation transcript:

1 CONFOUNDING EQUIVALENCE Judea Pearl – UCLA, USA Azaria Paz – Technion, Israel (

2 CONFOUNDING EQUIVALENCE W1W1 W4W4 XY V2V2 V1V1 W2W2 W3W3 Z T L Z  T ? PROBLEM: When would two measurements be equally effective for reducing confounding bias? Bias =

3 CONFOUNDING EQUIVALENCE DEFINITION AND SOLUTION DEFINITION: T and Z are c -equivalent if DEFINITION (Markov boundary): Markov boundary S m of S (relative to X ) is the minimal subset of S that d -separates X from all other members of S. THEOREM: Z and T are c -equivalent iff 1. Z m =T m, or 2. Z and T are admissible (i.e., satisfy the back-door condition)

4 ARE Z AND T CONFOUNDING EQUIVALET? ANSWER: Yes! Because both are admissible W1W1 W4W4 XY V2V2 V1V1 W2W2 W3W3 Z T Z  T

5 ARE Z AND T CONFOUNDING EQUIVALET? W1W1 W4W4 XY V2V2 V1V1 W2W2 W3W3 Z T L ANSWER: No! None is admissible and Z  T

6 The definition of c -equivalence is purely statistical. The graphical criterion we found invokes “admissibility,” which is causal – why? Corollary 1: c -equivalence is an invariant property of M -equivalent graphs Corollary 2: There ought to be a graphical criterion that does not invoke “admissibility,” based on d -separation only. Indeed, Theorem: Z ~ T iff A PUZZLE: and

7 EXAMPLE: TESTING IF Z ~ T WITHOUT INVOKING ADMISSIBILITY W1W1 W4W4 XY V2V2 V1V1 W2W2 W3W3 ZT Z  T L W1W1 W4W4 V2V2 V1V1 W2W2 W3W3 ZT XY

8 W1W1 W2W2 Z1Z1 Z2Z2 XY V Z1Z1 Z2Z2 W1W1 W2W2 XY V (b)(a) APPLICATIONS TO MODEL TESTING Answer: No,  a CI that holds in (b) but not in (a) Answer: No, because { Z 1,W 1,W 2 } ~ { W 1,W 2,Z 2 } holds in (b) but not in (a) Which is easier to detect? Which is easier to test? Are these two models Markov-equivalent?

9 W1W1 W2W2 Z1Z1 Z2Z2 XY V Z1Z1 Z2Z2 W1W1 W2W2 XY V (b)(a) WHICH IS EASIER TO TEST WHEN Z IS HIGH DIMENSIONAL? Conditional independence? or c -equivalence? c -equivalence can invoke propensity scores (Scalars): And we can ignore the outcome process 

10 CONCLUSIONS c -equivalence provides: A simple, polynomial time test for deciding whether one set of measurements has the same bias-reducing potential as another. A powerful tool for: 1.Testing from sampled data, the validity of a given graphical model and, eventually, and 2.systematic search for graph structures.

11 CONCLUSIONS c -equivalence provides: A simple, polynomial time test for deciding whether one set of measurements has the same bias-reducing potential as another. A powerful tool for: 1.Testing from sampled data, the validity of a given graphical model and, eventually, and 2.systematic search for graph structures.