Presentation is loading. Please wait.

Presentation is loading. Please wait.

The Visual Causality Analyst: An Interactive Interface for Causal Reasoning Jun Wang, Stony Brook University Klaus Mueller, Stony Brook University, SUNY.

Published byDuane Dean Modified over 8 years ago

Similar presentations

Presentation on theme: "The Visual Causality Analyst: An Interactive Interface for Causal Reasoning Jun Wang, Stony Brook University Klaus Mueller, Stony Brook University, SUNY."— Presentation transcript:

1 The Visual Causality Analyst: An Interactive Interface for Causal Reasoning Jun Wang, Stony Brook University Klaus Mueller, Stony Brook University, SUNY Korea 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

2 Causality “Any relationship that cannot be defined from the distribution alone” [Pearl, 2010] Counterfactuals A causes B means: If A didn’t happen (change), B would not happen (change) All relations between variables in a system form a Causal Network 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

3 Causal Networks Causal networks can be represented as Bayesian belief networks Directed Acyclic Graphs (DAGs) Augmented with conditional probability distributions CPT, CPD, Linear Regression, Logistic Regression, etc. Probabilistic Dependency and Causal Dependency Thus causal networks can be learned as Bayesian networks But with added constraints and assumptions 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

4 Structure Learning Score-based algorithms Search through the space of possible structures (models) with some scoring function. K2 [Cooper & Herskowitz, 1992] GBPS [Spirtes & Meek, 1995] BDe metric [Heckerman et al. 1995] Sparse Candidate [Friedman et al. 1999] Exact [Koivisto & Sood, 2004][Silander & Myllymaki, 2006] GES [Chickering, 2002] GIES [Hauser & Bühlmann, 2012] … Constraint-based algorithms Find a graph that satisfies all the constraints implied by the data distribution. SGS [Spirtes et al. 2000] PC [Spirtes et al. 2000][Meek, 1995] TPDA [Cheng et al. 1997] Heuristic two-phase [Wang & Chan, 2010] TC [Pellet & Elisseeff, 2008] … 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

5 Structure Learning Score-based algorithmsConstraint-based algorithms Build structure constrained by conditional independence/dependence calculated from data distributions Such conditional dependencies imply causal dependence and counterfactuals 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

6 Conditional Independence and D-separation 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

7 D-separation 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University Faithfulness Assumption There is a graph capable to express all CI relations in data. Causal Sufficiency No hidden confounder or selection bias. Chain of CausationConfounding Collision (V-structure) Collider

8 TC Algorithm [Pellet & Elisseeff, 2008] Start from an empty graph, 1.For each pair of variables in dataset, test for CI conditioning on all other variables. Connect the pair if they are dependent. Output: Moral Graph 2.For each pair of connected variables, search for colliders in variables forming triangles with them. Require a number of CI test exponential to the number of potential colliders 3.Orient V-structures and propagate. Output: Partial DAG 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

9 CI Test 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

10 Correlations of Categorical & Numerical Variables 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University XYZXYXY XzXz A1526 A3726 B7182 B8282 B9382

11 Level Value Mapping of Categorical Variables 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University Variable pair categorical/numerical PairwiseGlobal origin/horsepower0.4880.476 origin/weight0.5950.561 origin/displacement0.6560.637 origin/mpg0.576-0.530 origin/timeTo60mph0.272-0.272

12 Causality in Practical Application CI tests require good data quality to make correct judgements. Satisfaction of causal assumptions cannot be guaranteed. Hard to manage all causal relations when variable number is large. Cannot alter the learned structure and test hypotheses. Solution A Visual Analytical System! 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

13 The Visual Causality Analyst 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University Running on auto mpg dataset [UCI Machine Learning Repository, 2013]

14 The Causality Analyst Analytical Stages 1.Data preparation Mapping levels of categorical variables 2.Structure Learning Learn causal structures with the TC algorithm 3.Regression Analysis Quantify causal relations with linear and logistic regression analyses Make dummy variables out of categorical variables 4.Visual Analytics with the Causal Graph Interactive analysis with visual feedback 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

15 Visualization Patterns Vertices: variables Color: type of the variable ( numerical categorical) Edges: causal relations Direction Marks: direction and qualities of causal relation positive negative multiple Opacity: (maximum) causal strength measured by regression coefficients, scaled and enhanced by Dashed line: relation with unknown direction 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

16 Regression Analysis Linear regression analysis Numerical dependent variable p-value, F-statistics, R-squared, etc. Logistic regression analysis Categorical dependent variable p-value, Deviance, Likelihood, etc. 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

17 Case 1: Auto MPG dataset [UCI Machine Learning Repository, 2013] 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University The complete causal graph Filter edges with 0.4 coefficient threshold The causal chain related to mpg 8 variables, 392 observations

18 Case 1: Auto MPG dataset [UCI Machine Learning Repository, 2013] 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University The added causal relationRegression view of mpg before adding the edge Regression view of mpg after adding the edge

19 Case 2: Sales Campaign Dataset 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University The causal graphAll relations related to PipeRevn Regression view of PipeRevn and Cost 10 variables, 600 observations

20 Future Work Analytical visualization Visualize goodness of fitting for regression models of each node as node stroke thickness e.g. F-test score or Deviance, Automatic predictor analysis Automatic predictor analysis Fit data on existed structure Scoring the graph structure according to the dataset Causal inference within data clusters Integrate tools like Illustrative Parallel Coordinates [McDonnell and Klaus, 2008] Causality from time series data Time series chain graph and Granger causality graphs [Eichler, 2008] 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

21 Other Potential Future Work More sophisticated CI test equivalence Data cleaning, e.g. outlier detection and removal Handling big data, e.g. incremental visualization Causal analysis involving interventional data … 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

22 Summary Causality and Causal Network Constraint-based Structural Learning Value Mapping of Categorical Variables The Visual Causal Analyst Analytical Stages Visualization of Causal Graph with Statistical Assessment Interactive Analysis with Visual Feedback Prototype with Many Potential Future Work 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

23 Thanks for attending my talk! 10/28/2015Jun Wang and Klaus Mueller, Stony Brook University

Download ppt "The Visual Causality Analyst: An Interactive Interface for Causal Reasoning Jun Wang, Stony Brook University Klaus Mueller, Stony Brook University, SUNY."

Similar presentations

CS188: Computational Models of Human Behavior

CS188: Computational Models of Human Behavior
Bayesian network for gene regulatory network construction

Bayesian network for gene regulatory network construction
A Tutorial on Learning with Bayesian Networks

A Tutorial on Learning with Bayesian Networks
Discovering Cyclic Causal Models by Independent Components Analysis Gustavo Lacerda Peter Spirtes Joseph Ramsey Patrik O. Hoyer.

Discovering Cyclic Causal Models by Independent Components Analysis Gustavo Lacerda Peter Spirtes Joseph Ramsey Patrik O. Hoyer.
© Department of Statistics 2012 STATS 330 Lecture 32: Slide 1 Stats 330: Lecture 32.

© Department of Statistics 2012 STATS 330 Lecture 32: Slide 1 Stats 330: Lecture 32.
Weakening the Causal Faithfulness Assumption

Weakening the Causal Faithfulness Assumption
Outline 1)Motivation 2)Representing/Modeling Causal Systems 3)Estimation and Updating 4)Model Search 5)Linear Latent Variable Models 6)Case Study: fMRI.

Outline 1)Motivation 2)Representing/Modeling Causal Systems 3)Estimation and Updating 4)Model Search 5)Linear Latent Variable Models 6)Case Study: fMRI.
Forecasting Using the Simple Linear Regression Model and Correlation

Forecasting Using the Simple Linear Regression Model and Correlation
Exact Inference in Bayes Nets

Exact Inference in Bayes Nets
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.

6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Experiments We measured the times(s) and number of expanded nodes to previous heuristic using BFBnB. Dynamic Programming Intuition. All DAGs must have.

Experiments We measured the times(s) and number of expanded nodes to previous heuristic using BFBnB. Dynamic Programming Intuition. All DAGs must have.
Graduate Center/City University of New York University of Helsinki FINDING OPTIMAL BAYESIAN NETWORK STRUCTURES WITH CONSTRAINTS LEARNED FROM DATA Xiannian.

Graduate Center/City University of New York University of Helsinki FINDING OPTIMAL BAYESIAN NETWORK STRUCTURES WITH CONSTRAINTS LEARNED FROM DATA Xiannian.
Introduction of Probabilistic Reasoning and Bayesian Networks

Introduction of Probabilistic Reasoning and Bayesian Networks
Causal Networks Denny Borsboom. Overview The causal relation Causality and conditional independence Causal networks Blocking and d-separation Excercise.

Causal Networks Denny Borsboom. Overview The causal relation Causality and conditional independence Causal networks Blocking and d-separation Excercise.
Rafi Bojmel supervised by Dr. Boaz Lerner Automatic Threshold Selection for conditional independence tests in learning a Bayesian network.

Rafi Bojmel supervised by Dr. Boaz Lerner Automatic Threshold Selection for conditional independence tests in learning a Bayesian network.
Using Markov Blankets for Causal Structure Learning Jean-Philippe Pellet Andre Ellisseeff Presented by Na Dai.

Using Markov Blankets for Causal Structure Learning Jean-Philippe Pellet Andre Ellisseeff Presented by Na Dai.
Integrating Bayesian Networks and Simpson’s Paradox in Data Mining Alex Freitas University of Kent Ken McGarry University of Sunderland.

Integrating Bayesian Networks and Simpson’s Paradox in Data Mining Alex Freitas University of Kent Ken McGarry University of Sunderland.
Regulatory Network (Part II) 11/05/07. Methods Linear –PCA (Raychaudhuri et al. 2000) –NIR (Gardner et al. 2003) Nonlinear –Bayesian network (Friedman.

Regulatory Network (Part II) 11/05/07. Methods Linear –PCA (Raychaudhuri et al. 2000) –NIR (Gardner et al. 2003) Nonlinear –Bayesian network (Friedman.
Bayesian Network Representation Continued

Bayesian Network Representation Continued
Nemours Biomedical Research Statistics April 2, 2009 Tim Bunnell, Ph.D. & Jobayer Hossain, Ph.D. Nemours Bioinformatics Core Facility.

Nemours Biomedical Research Statistics April 2, 2009 Tim Bunnell, Ph.D. & Jobayer Hossain, Ph.D. Nemours Bioinformatics Core Facility.

Similar presentations

Ads by Google