Daniel Guetta (DRO)Transitional Care Units IEOR 8100.003 Final Project 9 th May 2012 Daniel Guetta Joint work with Carri Chan.

Slides:



Advertisements
Similar presentations
CS188: Computational Models of Human Behavior
Advertisements

Bayesian network for gene regulatory network construction
Naïve Bayes. Bayesian Reasoning Bayesian reasoning provides a probabilistic approach to inference. It is based on the assumption that the quantities of.
Variational Methods for Graphical Models Micheal I. Jordan Zoubin Ghahramani Tommi S. Jaakkola Lawrence K. Saul Presented by: Afsaneh Shirazi.
BAYESIAN NETWORKS. Bayesian Network Motivation  We want a representation and reasoning system that is based on conditional independence  Compact yet.
Psychology 290 Special Topics Study Course: Advanced Meta-analysis April 7, 2014.
1 12. Principles of Parameter Estimation The purpose of this lecture is to illustrate the usefulness of the various concepts introduced and studied in.
Expectation Maximization
Dynamic Bayesian Networks (DBNs)
Point-and-Line Problems. Introduction Sometimes we can find an exisiting algorithm that fits our problem, however, it is more likely that we will have.
An Introduction to Variational Methods for Graphical Models.
Introduction of Probabilistic Reasoning and Bayesian Networks
Hidden Markov Models M. Vijay Venkatesh. Outline Introduction Graphical Model Parameterization Inference Summary.
GS 540 week 6. HMM basics Given a sequence, and state parameters: – Each possible path through the states has a certain probability of emitting the sequence.
Visual Recognition Tutorial
Regulatory Network (Part II) 11/05/07. Methods Linear –PCA (Raychaudhuri et al. 2000) –NIR (Gardner et al. 2003) Nonlinear –Bayesian network (Friedman.
Chapter 4 Multiple Regression.
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 8 1Probability, Bayes’ theorem, random variables, pdfs 2Functions of.
Visual Recognition Tutorial
ECE 8443 – Pattern Recognition LECTURE 06: MAXIMUM LIKELIHOOD AND BAYESIAN ESTIMATION Objectives: Bias in ML Estimates Bayesian Estimation Example Resources:
BPS - 3rd Ed. Chapter 211 Inference for Regression.
Queueing Network Approach to the Analysis of Healthcare Systems H. Xie, T.J. Chaussalet and P.H. Millard Health and Social Care Modelling Group (HSCMG)
CJT 765: Structural Equation Modeling Class 7: fitting a model, fit indices, comparingmodels, statistical power.
A Comparison Between Bayesian Networks and Generalized Linear Models in the Indoor/Outdoor Scene Classification Problem.
Lecture 19: More EM Machine Learning April 15, 2010.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
Bayesian networks. Motivation We saw that the full joint probability can be used to answer any question about the domain, but can become intractable as.
1 Variable Elimination Graphical Models – Carlos Guestrin Carnegie Mellon University October 11 th, 2006 Readings: K&F: 8.1, 8.2, 8.3,
Inference Complexity As Learning Bias Daniel Lowd Dept. of Computer and Information Science University of Oregon Joint work with Pedro Domingos.
Survey Propagation. Outline Survey Propagation: an algorithm for satisfiability 1 – Warning Propagation – Belief Propagation – Survey Propagation Survey.
Module networks Sushmita Roy BMI/CS 576 Nov 18 th & 20th, 2014.
Ch 8. Graphical Models Pattern Recognition and Machine Learning, C. M. Bishop, Revised by M.-O. Heo Summarized by J.W. Nam Biointelligence Laboratory,
Course files
PROBABILITY AND STATISTICS FOR ENGINEERING Hossein Sameti Department of Computer Engineering Sharif University of Technology Principles of Parameter Estimation.
INTERVENTIONS AND INFERENCE / REASONING. Causal models  Recall from yesterday:  Represent relevance using graphs  Causal relevance ⇒ DAGs  Quantitative.
Introduction to LDA Jinyang Gao. Outline Bayesian Analysis Dirichlet Distribution Evolution of Topic Model Gibbs Sampling Intuition Analysis of Parameter.
Slides for “Data Mining” by I. H. Witten and E. Frank.
An Introduction to Variational Methods for Graphical Models
Learning In Bayesian Networks. General Learning Problem Set of random variables X = {X 1, X 2, X 3, X 4, …} Training set D = { X (1), X (2), …, X (N)
Lecture 2: Statistical learning primer for biologists
Simulation Study for Longitudinal Data with Nonignorable Missing Data Rong Liu, PhD Candidate Dr. Ramakrishnan, Advisor Department of Biostatistics Virginia.
1 Parameter Learning 2 Structure Learning 1: The good Graphical Models – Carlos Guestrin Carnegie Mellon University September 27 th, 2006 Readings:
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
1 Param. Learning (MLE) Structure Learning The Good Graphical Models – Carlos Guestrin Carnegie Mellon University October 1 st, 2008 Readings: K&F:
1 CMSC 671 Fall 2001 Class #20 – Thursday, November 8.
Joint Moments and Joint Characteristic Functions.
1 Learning P-maps Param. Learning Graphical Models – Carlos Guestrin Carnegie Mellon University September 24 th, 2008 Readings: K&F: 3.3, 3.4, 16.1,
Lecture 3: MLE, Bayes Learning, and Maximum Entropy
Bayesian Optimization Algorithm, Decision Graphs, and Occam’s Razor Martin Pelikan, David E. Goldberg, and Kumara Sastry IlliGAL Report No May.
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
G. Cowan Lectures on Statistical Data Analysis Lecture 9 page 1 Statistical Data Analysis: Lecture 9 1Probability, Bayes’ theorem 2Random variables and.
1 Structure Learning (The Good), The Bad, The Ugly Inference Graphical Models – Carlos Guestrin Carnegie Mellon University October 13 th, 2008 Readings:
Computational methods for inferring cellular networks II Stat 877 Apr 17 th, 2014 Sushmita Roy.
1 Variable Elimination Graphical Models – Carlos Guestrin Carnegie Mellon University October 15 th, 2008 Readings: K&F: 8.1, 8.2, 8.3,
The NP class. NP-completeness Lecture2. The NP-class The NP class is a class that contains all the problems that can be decided by a Non-Deterministic.
BPS - 5th Ed. Chapter 231 Inference for Regression.
1 BN Semantics 3 – Now it’s personal! Parameter Learning 1 Graphical Models – Carlos Guestrin Carnegie Mellon University September 22 nd, 2006 Readings:
The NP class. NP-completeness
Lecture 7: Constrained Conditional Models
Learning to Satisfy Actuator Networks
Hidden Markov Models Part 2: Algorithms
More about Posterior Distributions
Structure and Semantics of BN
Discrete Event Simulation - 4
Basic Practice of Statistics - 3rd Edition Inference for Regression
LECTURE 21: CLUSTERING Objectives: Mixture Densities Maximum Likelihood Estimates Application to Gaussian Mixture Models k-Means Clustering Fuzzy k-Means.
Structure and Semantics of BN
Parameter Learning 2 Structure Learning 1: The good
Learning From Observed Data
BN Semantics 3 – Now it’s personal! Parameter Learning 1
Presentation transcript:

Daniel Guetta (DRO)Transitional Care Units IEOR Final Project 9 th May 2012 Daniel Guetta Joint work with Carri Chan

Daniel Guetta (DRO)Transitional Care Units This talk Hospitals Bayesian Networks Data! Modified EM Algorithm First results Instrumental variables Convex optimization Learning Structure Where to?

Daniel Guetta (DRO)Transitional Care Units Context – hospitals Emergency department Operating room Intensive Care Unit Medical Floor

Daniel Guetta (DRO)Transitional Care Units Context – hospitals Emergency department Operating room Intensive Care Unit Medical Floor

Daniel Guetta (DRO)Transitional Care Units Context – hospitals Emergency department Operating room Intensive Care Unit Medical Floor

Daniel Guetta (DRO)Transitional Care Units Context – hospitals Emergency department Operating room Intensive Care Unit Medical Floor Transitional Care Unit

Daniel Guetta (DRO)Transitional Care Units The Question Does the “introduction” of Transitional Care Units (TCUs) “improve” the “quality” of a hospital?

Daniel Guetta (DRO)Transitional Care Units Literature TCUs are good… K. M. Stacy. Progressive Care Units: Different but the Same. Critical Care Nurse A.D. Harding. What Can an Intermediate Care Unit Do For You? Journal of Nursing Administration TCUs are bad… J. L. Vincent and H. Burchardi. Do we need intermediate care units? Intensive Care Medicine. We don’t know… S. P. Keenan et. al. A Systematic Review of the Cost- Effectiveness of Noncardiac Transitional Care Units. Chest.

Daniel Guetta (DRO)Transitional Care Units Available Data & Related Issues

Daniel Guetta (DRO)Transitional Care Units Available data Removed for Confidentiality Reasons

Daniel Guetta (DRO)Transitional Care Units Complications Mounds and mounds of unobserved data Periods of low hospital utilization Critically ill patients getting rush treatment Variation across doctors/wards, etc… Endless additional complications Endogeneity Difficult to use TCU sizes for comparisons across hospitals. Determining capacities

Daniel Guetta (DRO)Transitional Care Units Unit capacities Removed for Confidentiality Reasons

Daniel Guetta (DRO)Transitional Care Units Convex optimization Consider the following optimization program with 365 decision variables C 1 to C 365, representing the capacities at each of the 365 days in the year. We wish to find the values of these decision variables that Best fit the observed occupancies O 1 to O 365. Reduce the number of occupancy changes Ideally, we’d like to solve

Daniel Guetta (DRO)Transitional Care Units Convex optimization  ( C i, O i ) OiOi Fitted Capacity O i – 5

Daniel Guetta (DRO)Transitional Care Units E-M Algorithm Decide how many clusters to use Assign each point to a random cluster Repeat For each cluster, given the points therein, find the MLE capacity Go through each point, and find the most likely cluster it might belong to

Daniel Guetta (DRO)Transitional Care Units E-M Algorithm – distribution Probability Occupancy C + 10 CC/2

Daniel Guetta (DRO)Transitional Care Units Bayesian Networks

Daniel Guetta (DRO)Transitional Care Units Bayesian Networks Season Flu Hayfever Muscle pain Congestion

Daniel Guetta (DRO)Transitional Care Units Bayesian Networks Season Flu Hayfever Muscle pain Congestio n Assuming the X are topologically ordered, the set X 1  i – 1 contains every parent of X i, and none of its descendants Thus, since, we can write

Daniel Guetta (DRO)Transitional Care Units Bayesian Networks Season Flu Hayfever Muscle pain Congestio n

Daniel Guetta (DRO)Transitional Care Units Why Bayesian Networks? Representation The distribution of n binary RVs requires 2 n – 1 numbers. A Bayesian network introduces some independences and dramatically reduces this. It also adds some transparency to the distribution. Inference Many specialized algorithms exist for performing efficient inference on Bayesian networks. These algorithms are generally astronomically faster than equivalent algorithms using the full joint distribution.

Daniel Guetta (DRO)Transitional Care Units Application to TCUs Many algorithms exist to learn BN structure from data. These elicit structure from “messy” data. My hope with this project was to use these algorithms to discover structure in the hospital data, and therefore get some insight into the effect of TCUs on various performance measures. Seems especially relevant in this case, “Performance” is not easy to summarize using a single number, which makes regression-like methods difficult. It’s unclear where variation comes from. I had high hopes that the method would be able to cope with endogeneity issues (more on this later).

Daniel Guetta (DRO)Transitional Care Units Learning Bayesian Networks Structural methods Score-based methods Bayesian methods

Daniel Guetta (DRO)Transitional Care Units Structural methods We have already seen that in Bayesian Network As we explained, it turns out that there are many more independencies encoded in a Bayesian Network. Two networks are said to be I-Equivalent if they encode the same set of independencies.

Daniel Guetta (DRO)Transitional Care Units Structural methods We have already seen that in Bayesian Network As we explained, it turns out that there are many more independencies encoded in a Bayesian Network. Two networks are said to be I-Equivalent if they encode the same set of independencies. It can be shown that two networks are in the same I- Equivalence class if and only if The networks have the same skeleton The networks have the same set of immoralities An immorality is any set of three nodes arranged in the following pattern XY Z

Daniel Guetta (DRO)Transitional Care Units Structural methods Finding the skeleton If X – Y exists (in either direction), there will be no set U such that X is independent of Y given U. Thus, if we find any such witness set U, the edge does not exist. If the graph has bounded in-degree (< d, say), we only need to consider witness sets of size < d. Finding the immoralities Any set of edges X – Y – Z with no X – Z link is a potential immorality. It can be shown that the set is an immorality if and only if all witness sets U contain Z.

Daniel Guetta (DRO)Transitional Care Units Score-based methods Maximum likelihood parameters for a given structure Given network structure Data A multinomial distribution for each variable is often assumed when calculating the maximum likelihood parameters. Recall that given a network structure, the distribution factors as this reduces the search for a global ML parameter to a series of small local searches.

Daniel Guetta (DRO)Transitional Care Units Bayesian methods This score is typically calculated assuming multinomial distributions for the variables and Dirichlet priors on the parameters.

Daniel Guetta (DRO)Transitional Care Units Bayesian methods This score is typically calculated assuming multinomial distributions for the variables and Dirichlet priors on the parameters. For those distributions and priors satisfying certain (not-too- restrictive) properties, the Bayesian score can easily be expressed in a more palatable form. “Easy” and “palatable” are relative terms…

Daniel Guetta (DRO)Transitional Care Units An example Season Flu Hayfever Muscle pain Congestion ILLWINSPRSUMFAL Flu Hay CON. Hay NoYes Flu No.1.9 Yes.8.95 M.P.Prob Flu No.1 Yes.9 WINSPRSUMFAL Prob

Daniel Guetta (DRO)Transitional Care Units Motivating Results

Daniel Guetta (DRO)Transitional Care Units The plan ED Length of Stay ICU Length of Stay ED Length of Stay ICU Length of Stay Without TCUWith TCU

Daniel Guetta (DRO)Transitional Care Units The problem & the solution ED Length- of-stay ICU Length- of-stay Gravity of illness + + – ICU Congested? + Hospital in question

Daniel Guetta (DRO)Transitional Care Units The problem & the solution ICU Congested ED Length- of-stay ICU not Congested ED Length- of-stay Gravity of illness No significant difference Yes significant difference ICU Length- of-stay

Daniel Guetta (DRO)Transitional Care Units The problem – technical version ICU Length- of-stay = ED Length- of-stay + Gravity of illness Hospital in question etc...

Daniel Guetta (DRO)Transitional Care Units The solution – technical version Consider fitting the following model. In ordinary-least squares, we’d take the covariance of both sides with EDLOS, to obtain Instead, take the covariance of each side with I, to obtain

Daniel Guetta (DRO)Transitional Care Units The solution – technical version We can divide both sides by the variance of I We can write this as Suppose we carry out regression (1) above, and then…

Daniel Guetta (DRO)Transitional Care Units TCU Data Removed for Confidentiality Reasons

Daniel Guetta (DRO)Transitional Care Units First Results with Bayesian Networks

Daniel Guetta (DRO)Transitional Care Units Excluded effects Removed for Confidentiality Reasons

Daniel Guetta (DRO)Transitional Care Units Result Removed for Confidentiality Reasons

Daniel Guetta (DRO)Transitional Care Units Where to?

Daniel Guetta (DRO)Transitional Care Units Simplify, simplify, simplify… Looks at specific pathways rather than entire data sets Operating room  TCU vs. Operating room  ICU. How TCUs affect the Operating room  ICU pathway. When considering ICU patients, look at ICU readmission Look at specific types of patients (cardiac, for example – especially in hospital 24) Explore different types of methods for fitting Bayesian networks (ie: structural or Bayesian approaches) Obtain more data in regard to capacities