Source Term Estimation via SMC SAMSI Undergraduate Workshop 31/10/08 Dr Nathan Green, UK MOD.

Slides:



Advertisements
Similar presentations
SAMSI Discussion Session Random Sets/ Point Processes in Multi-Object Tracking: Vo Dr Daniel Clark EECE Department Heriot-Watt University UK.
Advertisements

Unsupervised Learning
Pattern Recognition and Machine Learning
Psychology 290 Special Topics Study Course: Advanced Meta-analysis April 7, 2014.
Bayesian Estimation in MARK
A Brief Introduction to Bayesian Inference Robert Van Dine 1.
Modeling Uncertainty over time Time series of snapshot of the world “state” we are interested represented as a set of random variables (RVs) – Observable.
Flipping A Biased Coin Suppose you have a coin with an unknown bias, θ ≡ P(head). You flip the coin multiple times and observe the outcome. From observations,
Markov-Chain Monte Carlo
Introduction of Probabilistic Reasoning and Bayesian Networks
On-Line Probabilistic Classification with Particle Filters Pedro Højen-Sørensen, Nando de Freitas, and Torgen Fog, Proceedings of the IEEE International.
Bayesian Biosurveillance Gregory F. Cooper Center for Biomedical Informatics University of Pittsburgh The research described in this.
Ai in game programming it university of copenhagen Statistical Learning Methods Marco Loog.
1 Vertically Integrated Seismic Analysis Stuart Russell Computer Science Division, UC Berkeley Nimar Arora, Erik Sudderth, Nick Hay.
Formation et Analyse d’Images Session 8
A: A Unified Brand-name-Free Introduction to Planning Subbarao Kambhampati Environment What action next? The $$$$$$ Question.
TOWARD DYNAMIC GRASP ACQUISITION: THE G-SLAM PROBLEM Li (Emma) Zhang and Jeff Trinkle Department of Computer Science, Rensselaer Polytechnic Institute.
Introduction  Bayesian methods are becoming very important in the cognitive sciences  Bayesian statistics is a framework for doing inference, in a principled.
Autonomous Robot Navigation Panos Trahanias ΗΥ475 Fall 2007.
Motion Detection And Analysis Michael Knowles Tuesday 13 th January 2004.
Particle Filters Pieter Abbeel UC Berkeley EECS Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics TexPoint fonts used in EMF. Read.
SLAM: Simultaneous Localization and Mapping: Part I Chang Young Kim These slides are based on: Probabilistic Robotics, S. Thrun, W. Burgard, D. Fox, MIT.
Part 2 of 3: Bayesian Network and Dynamic Bayesian Network.
Particle Filters for Mobile Robot Localization 11/24/2006 Aliakbar Gorji Roborics Instructor: Dr. Shiri Amirkabir University of Technology.
1 Integration of Background Modeling and Object Tracking Yu-Ting Chen, Chu-Song Chen, Yi-Ping Hung IEEE ICME, 2006.
City College of New York 1 Dr. John (Jizhong) Xiao Department of Electrical Engineering City College of New York A Taste of Localization.
Robin McDougall, Ed Waller and Scott Nokleby Faculties of Engineering & Applied Science and Energy Systems & Nuclear Science 1.
Jeff Howbert Introduction to Machine Learning Winter Classification Bayesian Classifiers.
Wind Power Analysis Using Non-Standard Statistical Models
1 Bayesian methods for parameter estimation and data assimilation with crop models Part 2: Likelihood function and prior distribution David Makowski and.
Overview G. Jogesh Babu. Probability theory Probability is all about flip of a coin Conditional probability & Bayes theorem (Bayesian analysis) Expectation,
1 DHS Bioterrorism Risk Assessment Background, Requirements, and Overview DHS Bioterrorism Risk Assessment Background, Requirements, and Overview Steve.
How do Scientists Think?
Conditional & Joint Probability A brief digression back to joint probability: i.e. both events O and H occur Again, we can express joint probability in.
BraMBLe: The Bayesian Multiple-BLob Tracker By Michael Isard and John MacCormick Presented by Kristin Branson CSE 252C, Fall 2003.
EM and expected complete log-likelihood Mixture of Experts
Optimal predictions in everyday cognition Tom Griffiths Josh Tenenbaum Brown University MIT Predicting the future Optimality and Bayesian inference Results.
Dstl is part of the Ministry of Defence © Crown Copyright Dstl 2012 Anticipating the Insurgent Response Fiona Browning Land Battlespace Systems Department.
Naive Bayes Classifier
STUDY, MODEL & INTERFACE WITH MOTOR CORTEX Presented by - Waseem Khatri.
The Science of Prediction Location Intelligence Conference April 4, 2006 How Next Generation Traffic Services Will Impact Business Dr. Oliver Downs, Chief.
Comparison of Bayesian Neural Networks with TMVA classifiers Richa Sharma, Vipin Bhatnagar Panjab University, Chandigarh India-CMS March, 2009 Meeting,
Bayesian Inversion of Stokes Profiles A.Asensio Ramos (IAC) M. J. Martínez González (LERMA) J. A. Rubiño Martín (IAC) Beaulieu Workshop ( Beaulieu sur.
Computer Science, Software Engineering & Robotics Workshop, FGCU, April 27-28, 2012 Fault Prediction with Particle Filters by David Hatfield mentors: Dr.
Forward-Scan Sonar Tomographic Reconstruction PHD Filter Multiple Target Tracking Bayesian Multiple Target Tracking in Forward Scan Sonar.
Practical Statistics for Particle Physicists Lecture 3 Harrison B. Prosper Florida State University European School of High-Energy Physics Anjou, France.
1 A Bayesian statistical method for particle identification in shower counters IX International Workshop on Advanced Computing and Analysis Techniques.
Probability and Measure September 2, Nonparametric Bayesian Fundamental Problem: Estimating Distribution from a collection of Data E. ( X a distribution-valued.
The Hardware Design of the Humanoid Robot RO-PE and the Self-localization Algorithm in RoboCup Tian Bo Control and Mechatronics Lab Mechanical Engineering.
Processing Sequential Sensor Data The “John Krumm perspective” Thomas Plötz November 29 th, 2011.
Expectation-Maximization (EM) Case Studies
Computer Vision Group Prof. Daniel Cremers Autonomous Navigation for Flying Robots Lecture 5.3: Reasoning with Bayes Law Jürgen Sturm Technische Universität.
Unscented Kalman Filter (UKF) CSCE 774 – Guest Lecture Dr. Gabriel Terejanu Fall 2015.
Probabilistic Robotics
OBJECT TRACKING USING PARTICLE FILTERS. Table of Contents Tracking Tracking Tracking as a probabilistic inference problem Tracking as a probabilistic.
The Value of Information John Medhurst, Larrainzar Consulting Solutions Ltd Maj Ian Stanton, Dstl Ian Mitchell, Dstl.
JSTO Sensor Data Fusion Program Goals Workshop on Chemical Data Assimilation John Pace DTRA/CBT 21 June 2005.
Kansas State University Department of Computing and Information Sciences CIS 730: Introduction to Artificial Intelligence Lecture 24 of 41 Monday, 18 October.
Probabilistic Robotics Introduction Probabilities Bayes rule Bayes filters.
COV outline Case study 1: Model with expert judgment (limited data): Perceived probability of explosive magmatic eruption of La Soufriere, Guadeloupe,
Bayesian Brain Probabilistic Approaches to Neural Coding 1.1 A Probability Primer Bayesian Brain Probabilistic Approaches to Neural Coding 1.1 A Probability.
Naive Bayes Classifier. REVIEW: Bayesian Methods Our focus this lecture: – Learning and classification methods based on probability theory. Bayes theorem.
Lecture 1.31 Criteria for optimal reception of radio signals.
ICS 280 Learning in Graphical Models
Department of Civil and Environmental Engineering
Course: Autonomous Machine Learning
Introduction to particle filter
Introduction to particle filter
Bayes for Beginners Luca Chech and Jolanda Malamud
Bayesian Statistics on a Shoestring Assaf Oron, May 2008
Presentation transcript:

Source Term Estimation via SMC SAMSI Undergraduate Workshop 31/10/08 Dr Nathan Green, UK MOD

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Contents Introduction Background Solutions… Technical details Application Toy model, R implementation

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Introduction I’m going to concentrate on one particular application of SMC methodology This is a –real-life –important problem Hopefully, highlight the practicality of using an SMC approach and demonstrate its use in the real world

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Me Brief history Skills and knowledge Current role and responsibilities

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Who are DSTL? Part of the Ministry of Defence

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Who are we? Not in the Army, Navy or Air Force Civil servants – civilians who work for the government Our job is to: –Carry out research for the Ministry of Defence –Help the MoD to buy our forces the best equipment –Keep our forces safe

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Covert Hazardous Releases

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED The Problem: Source Term Estimation In order to protect UK forces in the event of a CBRN event it will be necessary to make a hazard prediction Accurate hazard prediction requires knowledge of a source term Source term estimation provides the ability to take sensor readings and provide a source term and therefore a hazard prediction This allows commanders to protects their forces and plan counter measures

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Aim Develop a Real-time Source-Term Estimation capability –To make best estimates of the parameters of the release –From low resolution alarms or high resolution time series data –Produce results in a timely fashion, i.e. Under 5 minutes

Example Problem

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Release Modelled Release Mass –60 kg Agent –GB Location of Release –30UXC (MGRS) –51°29’54.4”N 0°27’26.8”W (Lat Lon) Time of Release –011200ZNOV2007 Basic Met –Wind speed 18kmh –Easterly Wind Direction –Neutral Conditions

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Sensor Configuration

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Current solution

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Current Solution (with troops)

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Current Solution and source term estimation from SMC

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED The Model We want to estimate the (static) source term parameters The only information we have about a release is through sensor measurements downwind, y So we want to estimate on-line the source term parameters as more data arrives Use a Bayesian approach!

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Bayes Theorem Posterior Likelihood Prior

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Method of Solution How can we address this problem? –MCMC? –Kalman Filter? –Particle Filter? Advantage/Drawbacks

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Prior Knowledge We know that given a positive sensor measurement the release time will have been in the past! We can have an idea of where is likely to be attacked/protected Previous scenario information can be used, perhaps through an MCMC approach

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Likelihood Function The likelihood is a way in which the data can be incorporated into our analysis It can be thought of as supplying the evidence in support of a given model In our case, the data (sensor measurements) tell use about the source term via an unobserved concentration

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Unobserved Concentration Assume that the concentration at some point in time and space has a Clipped Gaussian distribution

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Clipped Gaussian Curve

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Sensors Many different sensors to model: –Chemical Releases Bar sensor Threshold sensor Concentration realisation sensor –Biological Releases Particle Detector / Resonant Mirror –Radiological Releases Long Range Gamma Sensor

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Key Elements Generate a ‘cloud’ of source term hypotheses (particles) A dispersion model produces concentration probability distributions at each sensor location and time point for every hypothesis Sensor models use these probabilities to create likelihood values for these hypotheses The hypotheses are updated in light of in-coming sensor measurement

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Particle Diversity Unfortunately, the initial source term estimates may not prove to be very good guesses In this case, we may be left with just a single decent particle To remedy this problem a ‘diversifying’ step is included –New particles are probabilistically generated and accepted –A Metropolis-Hastings MCMC step

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Algorithm Description

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Algorithm Description

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Algorithm Description

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Algorithm Description

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Algorithm Description

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Algorithm Description

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Chemical Release Example Video Video

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED R code

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED R code

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED R code

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Example Output

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Marginals

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Trace Plots

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Dispersion Model Output

© Dstl October 2008 Dstl is part of the Ministry of Defence UNCLASSIFIED Note on Estimation Bias A small release mass close to the sensor array and a large release mass further away from the sensors produce comparable concentration measurements at the sensors –The release location estimate is likely to be over-predicted (i.e. further away) –In terms of warning and reporting, will err on the side of safety and predict a larger affected hazard area Close to sensors Further from sensors Concentration Sensor y location