Bayesian Disease Outbreak Detection that Includes a Model of Unknown Diseases Yanna Shen and Gregory F. Cooper Intelligent Systems Program and Department.

Slides:



Advertisements
Similar presentations
Evidence synthesis of competing interventions when there is inconsistency in how effectiveness outcomes are measured across studies Nicola Cooper Centre.
Advertisements

When Using DOPPS Slides. DOPPS Slide Use Guidelines.
Comments on Hierarchical models, and the need for Bayes Peter Green, University of Bristol, UK IWSM, Chania, July 2002.
Evaluating Diagnostic Accuracy of Prostate Cancer Using Bayesian Analysis Part of an Undergraduate Research course Chantal D. Larose.
2005 Syndromic Surveillance1 Estimating the Expected Warning Time of Outbreak- Detection Algorithms Yanna Shen, Weng-Keen Wong, Gregory F. Cooper RODS.
 2005 Carnegie Mellon University A Bayesian Scan Statistic for Spatial Cluster Detection Daniel B. Neill 1 Andrew W. Moore 1 Gregory F. Cooper 2 1 Carnegie.
1 A Tutorial on Bayesian Networks Weng-Keen Wong School of Electrical Engineering and Computer Science Oregon State University.
Bayesian Biosurveillance Gregory F. Cooper Center for Biomedical Informatics University of Pittsburgh The research described in this.
Anomaly Detection in the WIPER System using A Markov Modulated Poisson Distribution Ping Yan Tim Schoenharl Alec Pawling Greg Madey.
Decision Theoretic Analysis of Improving Epidemic Detection Izadi, M. Buckeridge, D. AMIA 2007,Symposium Proceedings 2007.
 2004 University of Pittsburgh Bayesian Biosurveillance Using Multiple Data Streams Weng-Keen Wong, Greg Cooper, Denver Dash *, John Levander, John Dowling,
 2004 University of Pittsburgh Bayesian Biosurveillance Using Multiple Data Streams Greg Cooper, Weng-Keen Wong, Denver Dash*, John Levander, John Dowling,
Lecture 5: Learning models using EM
Statistical Methods Chichang Jou Tamkang University.
Chapter 2: Bayesian Decision Theory (Part 1) Introduction Bayesian Decision Theory–Continuous Features All materials used in this course were taken from.
Communication-Efficient Distributed Monitoring of Thresholded Counts Ram Keralapura, UC-Davis Graham Cormode, Bell Labs Jai Ramamirtham, Bell Labs.
Information Extraction from Clinical Reports Wendy W. Chapman, PhD University of Pittsburgh Department of Biomedical Informatics.
An Optimal Learning Approach to Finding an Outbreak of a Disease Warren Scott Warren Powell
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
Model N : The total number of patients in an anthrax outbreak who are seen by clinicians. DT : The time to detect the anthrax outbreak Detection : The.
Bayesian Biosurveillance Using Causal Networks Greg Cooper RODS Laboratory and the Laboratory for Causal Modeling and Discovery Center for Biomedical Informatics.
Conclusions On our large scale anthrax attack simulations, being able to infer the work zip appears to improve detection time over just using the home.
Population-Wide Anomaly Detection Weng-Keen Wong 1, Gregory Cooper 2, Denver Dash 3, John Levander 2, John Dowling 2, Bill Hogan 2, Michael Wagner 2 1.
1 Bayesian Network Anomaly Pattern Detection for Disease Outbreaks Weng-Keen Wong (Carnegie Mellon University) Andrew Moore (Carnegie Mellon University)
Overview of ‘Syndromic Surveillance’ presented as background to Multiple Data Source Issue for DIMACS Working Group on Adverse Event/Disease Reporting,
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
1. Introduction Generally Intrusion Detection Systems (IDSs), as special-purpose devices to detect network anomalies and attacks, are using two approaches.
Bayesian inference review Objective –estimate unknown parameter  based on observations y. Result is given by probability distribution. Bayesian inference.
Bayesian networks Classification, segmentation, time series prediction and more. Website: Twitter:
Learning Stable Multivariate Baseline Models for Outbreak Detection Sajid M. Siddiqi, Byron Boots, Geoffrey J. Gordon, Artur W. Dubrawski The Auton Lab.
Combined Central and Subspace Clustering for Computer Vision Applications Le Lu 1 René Vidal 2 1 Computer Science Department, Johns Hopkins University,
Jhih-sin Jheng 2009/09/01 Machine Learning and Bioinformatics Laboratory.
Areej Jouhar & Hafsa El-Zain Biostatistics BIOS 101 Foundation year.
Bayesian Hypothesis Testing for Proportions Antonio Nieto / Sonia Extremera / Javier Gómez PhUSE Annual Conference, 9th-12th Oct 2011, Brighton UK.
Serghei Mangul Department of Computer Science Georgia State University Joint work with Irina Astrovskaya, Marius Nicolae, Bassam Tork, Ion Mandoiu and.
- 1 - Bayesian inference of binomial problem Estimating a probability from binomial data –Objective is to estimate unknown proportion (or probability of.
A New Hybrid Wireless Sensor Network Localization System Ahmed A. Ahmed, Hongchi Shi, and Yi Shang Department of Computer Science University of Missouri-Columbia.
The generalization of Bayes for continuous densities is that we have some density f(y|  ) where y and  are vectors of data and parameters with  being.
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 Unsupervised Learning with Mixed Numeric and Nominal Data.
A Bayesian Method for Rank Agreggation Xuxin Liu, Jiong Du, Ke Deng, and Jun S Liu Department of Statistics Harvard University.
Speaker : Yu-Hui Chen Authors : Dinuka A. Soysa, Denis Guangyin Chen, Oscar C. Au, and Amine Bermak From : 2013 IEEE Symposium on Computational Intelligence.
Bayesian Biosurveillance of Disease Outbreaks RODS Laboratory Center for Biomedical Informatics University of Pittsburgh Gregory F. Cooper, Denver H.
Matching ® ® ® Global Map Local Map … … … obstacle Where am I on the global map?                                   
Zhaoxia Fu, Yan Han Measurement Volume 45, Issue 4, May 2012, Pages 650–655 Reporter: Jing-Siang, Chen.
Introduction to Bayesian inference POORFISH workshop Helsinki Samu Mäntyniemi Fisheries and Environmental Management group (FEM) Department.
A Study on Speaker Adaptation of Continuous Density HMM Parameters By Chin-Hui Lee, Chih-Heng Lin, and Biing-Hwang Juang Presented by: 陳亮宇 1990 ICASSP/IEEE.
Gregory Cooper Professor of Biomedical Informatics Director, Center for Causal Discovery Vice Chair Research, Department of Biomedical Informatics.
Unsupervised Riemannian Clustering of Probability Density Functions
Bayesian Biosurveillance of Disease Outbreaks
New Directions in Pre-Syndromic and Subpopulation Health Surveillance
Maximum Likelihood Find the parameters of a model that best fit the data… Forms the foundation of Bayesian inference Slide 1.
Inference Concerning a Proportion
A Non-Parametric Bayesian Method for Inferring Hidden Causes
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John.
Gregory Cooper Professor of Biomedical Informatics Director, Center for Causal Discovery Vice Chair, Department of Biomedical Informatics Research involves.
Michael M. Wagner, MD PhD Professor, Department of Biomedical Informatics, University of Pittsburgh School of Medicine
A Short Tutorial on Causal Network Modeling and Discovery
Estimating the Expected Warning Time of Outbreak-Detection Algorithms
Example Human males have one X-chromosome and one Y-chromosome,
Gregory Cooper Professor of Biomedical Informatics Director, Center for Causal Discovery Vice Chair Research, Department of Biomedical Informatics.
CHAPTER 1 Exploring Data
CHAPTER 1 Exploring Data
CHAPTER 1 Exploring Data
ON BAYESIAN TESTS IN AUDITING
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John.
CHAPTER 1 Exploring Data
Mathematical Foundations of BME Reza Shadmehr
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John.
CHAPTER 1 Exploring Data
CHAPTER 1 Exploring Data
Presentation transcript:

Bayesian Disease Outbreak Detection that Includes a Model of Unknown Diseases Yanna Shen and Gregory F. Cooper Intelligent Systems Program and Department of Biomedical Informatics University of Pittsburgh

Introduction Outbreak detection algorithms: Outbreak detection algorithms: –Specific detection algorithms Look for pre-defined anomalous pattern in the data Look for pre-defined anomalous pattern in the data –Non-specific detection algorithms Try to detect any anomalous events, relative to some baseline of “normal” behavior Try to detect any anomalous events, relative to some baseline of “normal” behavior

Safety-net detection approaches Our safety-net algorithm: Our safety-net algorithm: –A hybrid method that combines the specific and non-specific detection approaches –Detect known causes of anomalies well while having the non-specific approach serve as a “safety-net” –Bayesian approach –Operate on a time series of Emergency Department (ED) patient symptoms such as cough, fever and diarrhea

The population-wide disease model outbreak disease in population fraction person_1 diseaseperson_2 diseaseperson_N disease person_1 evidence person_2 evidence person_N evidence...

An example population- wide disease model outbreak disease in population fraction person_1 diseaseperson_2 diseaseperson_N disease person_1 cough state person_2 cough state person_N cough state... person’s disease state person’s disease state Non-outbreak disease (d 0 ) specific outbreak disease (d k ) Unknown disease (d*) P(cough state = true | person’s disease state) p 0 ~ p 0 ~ Beta(α 0,β 0 ) p k p k ~ Beta(α k,β k ) p * ~ Beta(1,1)

Inference Derive the posterior probability P(pop_dx | data) Derive the posterior probability P(pop_dx | data) Derive P(data | pop_dx) Derive P(data | pop_dx) –Time complexity is exponential in N E (number of people who come to the ED) Adapted the inference method given in (Cooper 1995), which performs inference that is polynomial in N E Adapted the inference method given in (Cooper 1995), which performs inference that is polynomial in N E outbreak disease in population fraction person_1 disease person_2 disease person_n disease person_1 cough state person_2 cough state person_N cough state... pop_dx data P(cough | disease state) = p u, where p u ~ Beta(α u,β u )

Creating the datasets Create a background time series: Create a background time series: –Simulate the number of people who came to the ED on a given day without any disease outbreak –Simulate the cough status for each of these people Create the outbreak cases by using FLOO (Neill 2005) Create the outbreak cases by using FLOO (Neill 2005) Overlay the outbreak cases onto Overlay the outbreak cases onto the simulated background cases

Experimental setup 1 Let d u and d v be two CDC Category A diseases and d u ≠ d v Let d u and d v be two CDC Category A diseases and d u ≠ d v Model: Test data: A1B1

Result (A1 vs. B1) Plots showing the AMOC performances for experiment A1 and B1 Plots showing the AMOC performances for experiment A1 and B1

Experimental setup 2 Model: Test data: A2B2

Result (A2 vs. B2) Plots showing the AMOC performances for experiment A2 and B2 Plots showing the AMOC performances for experiment A2 and B2

Summary Introduced a Bayesian method for detecting disease outbreaks that combines a specific detection method with a non-specific method Introduced a Bayesian method for detecting disease outbreaks that combines a specific detection method with a non-specific method Provided support that this hybrid approach helps detect unexpected disease more than it interferes with detecting unknown diseases Provided support that this hybrid approach helps detect unexpected disease more than it interferes with detecting unknown diseases

Future work Explore distributions other than the uniform distribution for a disease symptom, such as cough, for the safety-net disease Explore distributions other than the uniform distribution for a disease symptom, such as cough, for the safety-net disease Extend the model to consider multiple person evidences Extend the model to consider multiple person evidences

Acknowledgements This research was funded by a grant from the National Science Foundation (NSF IIS ) This research was funded by a grant from the National Science Foundation (NSF IIS ) We thank the colleagues from the Department of Biomedical Informatics, the University of Pittsburgh, for their helpful comments on this work. We thank the colleagues from the Department of Biomedical Informatics, the University of Pittsburgh, for their helpful comments on this work. –Wendy Chapman –John Dowling –John Levander –Melissa Saul –Garrick Wallstrom