MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation 1 Optimal, Robust Information Fusion in Uncertain.

Slides:



Advertisements
Similar presentations
V-1 Part V: Collaborative Signal Processing Akbar Sayeed.
Advertisements

CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu Lecture 27 – Overview of probability concepts 1.
Exact Inference. Inference Basic task for inference: – Compute a posterior distribution for some query variables given some observed evidence – Sum out.
A Hierarchical Multiple Target Tracking Algorithm for Sensor Networks Songhwai Oh and Shankar Sastry EECS, Berkeley Nest Retreat, Jan
Exact Inference in Bayes Nets
ICCV 2007 tutorial Part III Message-passing algorithms for energy minimization Vladimir Kolmogorov University College London.
Dynamic Bayesian Networks (DBNs)
Probabilistic Robotics
Oklahoma State University Generative Graphical Models for Maneuvering Object Tracking and Dynamics Analysis Xin Fan and Guoliang Fan Visual Computing and.
Logistics Course reviews Project report deadline: March 16 Poster session guidelines: – 2.5 minutes per poster (3 hrs / 55 minus overhead) – presentations.
1 Graphical Models in Data Assimilation Problems Alexander Ihler UC Irvine Collaborators: Sergey Kirshner Andrew Robertson Padhraic Smyth.
Practical Belief Propagation in Wireless Sensor Networks Bracha Hod Based on a joint work with: Danny Dolev, Tal Anker and Danny Bickson The Hebrew University.
Report on Intrusion Detection and Data Fusion By Ganesh Godavari.
Process Query Systems ENGS 112 Lecture 7. Process Query Systems (PQS) vs Data Base Systems (DBS) Data Base System Process Query System Data Sources Data.
Computer vision: models, learning and inference Chapter 10 Graphical Models.
Bayesian Filtering for Location Estimation D. Fox, J. Hightower, L. Liao, D. Schulz, and G. Borriello Presented by: Honggang Zhang.
A Decentralised Coordination Algorithm for Mobile Sensors School of Electronics and Computer Science University of Southampton {rs06r2, fmdf08r, acr,
Bayesian Filtering for Robot Localization
Efficient Query Evaluation over Temporally Correlated Probabilistic Streams Bhargav Kanagal, Amol Deshpande ΗΥ-562 Advanced Topics on Databases Αλέκα Σεληνιωτάκη.
Decentralised Coordination of Mobile Sensors School of Electronics and Computer Science University of Southampton Ruben Stranders,
Cognitive Computer Vision Kingsley Sage and Hilary Buxton Prepared under ECVision Specific Action 8-3
Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields Yong-Joong Kim Dept. of Computer Science Yonsei.
Summary Alan S. Willsky SensorWeb MURI Review Meeting September 22, 2003.
Markov Localization & Bayes Filtering
/09/dji-phantom-crashes-into- canadian-lake/
From Bayesian Filtering to Particle Filters Dieter Fox University of Washington Joint work with W. Burgard, F. Dellaert, C. Kwok, S. Thrun.
Ohio State University Department of Computer Science and Engineering 1 Cyberinfrastructure for Coastal Forecasting and Change Analysis Gagan Agrawal Hakan.
1 Robot Environment Interaction Environment perception provides information about the environment’s state, and it tends to increase the robot’s knowledge.
Report on Intrusion Detection and Data Fusion By Ganesh Godavari.
Particle Filters.
Forward-Scan Sonar Tomographic Reconstruction PHD Filter Multiple Target Tracking Bayesian Multiple Target Tracking in Forward Scan Sonar.
MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation 1 Dynamic Sensor Resource Management for ATE MURI.
Energy-Efficient Signal Processing and Communication Algorithms for Scalable Distributed Fusion.
Value of Information 1 st year review. UCLA 2012 Kickoff VOI Kickoff ARO MURI on Value-centered Information Theory for Adaptive Learning, Inference, Tracking,
Approximate Dynamic Programming Methods for Resource Constrained Sensor Management John W. Fisher III, Jason L. Williams and Alan S. Willsky MIT CSAIL.
Continuous Variables Write message update equation as an expectation: Proposal distribution W t (x t ) for each node Samples define a random discretization.
1 Distributed and Optimal Motion Planning for Multiple Mobile Robots Yi Guo and Lynne Parker Center for Engineering Science Advanced Research Computer.
SCALABLE INFORMATION-DRIVEN SENSOR QUERYING AND ROUTING FOR AD HOC HETEROGENEOUS SENSOR NETWORKS Paper By: Maurice Chu, Horst Haussecker, Feng Zhao Presented.
Training Conditional Random Fields using Virtual Evidence Boosting Lin Liao, Tanzeem Choudhury †, Dieter Fox, and Henry Kautz University of Washington.
Tractable Inference for Complex Stochastic Processes X. Boyen & D. Koller Presented by Shiau Hong Lim Partially based on slides by Boyen & Koller at UAI.
DISTIN: Distributed Inference and Optimization in WSNs A Message-Passing Perspective SCOM Team
Exact Inference in Bayes Nets. Notation U: set of nodes in a graph X i : random variable associated with node i π i : parents of node i Joint probability:
CPSC 422, Lecture 17Slide 1 Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 17 Oct, 19, 2015 Slide Sources D. Koller, Stanford CS - Probabilistic.
Lucent Technologies - Proprietary 1 Interactive Pattern Discovery with Mirage Mirage uses exploratory visualization, intuitive graphical operations to.
Tracking with dynamics
MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation 1 Integrated Fusion, Performance Prediction, and.
Pattern Recognition and Machine Learning
Energy-Efficient Signal Processing and Communication Algorithms for Scalable Distributed Fusion.
Unclassified//For Official Use Only 1 RAPID: Representation and Analysis of Probabilistic Intelligence Data Carnegie Mellon University PI : Prof. Jaime.
Thrust IIB: Dynamic Task Allocation in Remote Multi-robot HRI Jon How (lead) Nick Roy MURI 8 Kickoff Meeting 2007.
Markov Networks: Theory and Applications Ying Wu Electrical Engineering and Computer Science Northwestern University Evanston, IL 60208
Daphne Koller Overview Maximum a posteriori (MAP) Probabilistic Graphical Models Inference.
Bayesian Belief Propagation for Image Understanding David Rosenberg.
Thrust IIA: Environmental State Estimation and Mapping Dieter Fox (Lead) Nicholas Roy MURI 8 Kickoff Meeting 2007.
SUPERVISED AND UNSUPERVISED LEARNING Presentation by Ege Saygıner CENG 784.
Integrative Genomics I BME 230. Probabilistic Networks Incorporate uncertainty explicitly Capture sparseness of wiring Incorporate multiple kinds of data.
Optimal, Robust Information Fusion in Uncertain Environments
SENSOR FUSION LAB RESEARCH ACTIVITIES PART I : DATA FUSION AND DISTRIBUTED SIGNAL PROCESSING IN SENSOR NETWORKS Sensor Fusion Lab, Department of Electrical.
MURI Kickoff Meeting Randolph L. Moses July 21, 2006
MURI Annual Review Meeting Randy Moses November 3, 2008
Innovative Front-End Signal Processing
Optimal, Robust Information Fusion in Uncertain Environments
Introduction to particle filter
CSCI 5822 Probabilistic Models of Human and Machine Learning
Introduction to particle filter
≠ Particle-based Variational Inference for Continuous Systems
Market-based Dynamic Task Allocation in Mobile Surveillance Systems
Nonparametric Hypothesis Tests for Dependency Structures
Overview: Chapter 2 Localization and Tracking
Information Sciences and Systems Lab
Presentation transcript:

MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation 1 Optimal, Robust Information Fusion in Uncertain Environments MURI Kickoff Meeting Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Alan S. Willsky July 21, 2006

2 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation What is needed: An expressive, flexible, and powerful framework Capable of capturing uncertain and complex sensor-target relationships Among a multitude of different observables and objects being sensed Capable of incorporating complex relationships about the objects being sensed Context, behavior patterns Admitting scalable, distributed fusion algorithms Admitting effective approaches to learning or discovering key relationships Providing the “glue” from front-end processing to sensor management

3 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Our choice: Graphical Models Extremely flexible and expressive framework Allows the possibility of capturing (or learning) relationships among features, object parts, objects, object behavior, and context E.g., constraints or relationships among parts, spatial and spatio- temporal relationships among objects, etc. Natural framework to consider distributed fusion While we can’t beat the dealer (NP-Hard is NP- Hard), The flexibility and structure of graphical models provides the potential for developing scalable, approximate algorithms

4 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Graphical Models 101 G = (V, E) = a graph V = Set of vertices E  V  V = Set of edges C = Set of cliques Markovianity on G (Hammersley-Clifford) P({x s | s  V})   C  C  C ( x C ) Objectives Estimation: Compute P s (x s ) Optimization: Argmax P({x s | s  V})

5 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Algorithms that do this on trees Message-passing algorithms for “estimation” (marginal computation) Two-sweep algorithms (leaves-root-leaves) For linear/Gaussian models, these are the generalizations of Kalman filters and smoothers Belief propagation, sum-product algorithm Non-directional (no root; all nodes are equal) Lots of freedom in message scheduling Message-passing algorithms for “optimization” (MAP estimation) Two sweep: Generalization of Viterbi/dynamic programming Max-product algorithm

6 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation In pictures…

7 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Comments and questions - I Other natural inference problems can be thought of as hypothesis testing on such models Estimating potentials Discovering/estimating “links” Distributed inference in comms-limited environments Performing inference tasks such as these Wonderfully scalable if the graphs are trees NP-Hard in general if they are not (which is the case for essentially all problems in this MURI) Beating the dealer in this case is crucial

8 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Comments and questions - II The Glue: Graphical models can capture relationships among observables and objects Allowing object hypotheses to influence front-end processing Think PEMS but with more sophisticated feedback from object hypotheses to front-end processing Allowing object hypotheses to influence what measurements should be made Again, think PEMS, with an expanded notion of what is involved in “search”

9 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation The Three Big Questions Why should we believe that graphical models can capture things of interest to this MURI? Why should we believe that it is possible to develop tractable and useful fusion algorithms based on such models? What are we going to do?

10 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Question #1: Why we think that graphical models are relevant—A few f’rinstances Multi-target tracking and data association Tracking of dynamically coupled and constrained objects Flexible framework for learning features-to-parts-to- objects models for object recognition in complex scenes Graphical Models for Shapes and their projections Robust association of heterogeneous signals and discovery of “links” among observed (possibly dynamic) variables Significant theoretical advances Performance bounds Substantial generalization of particle filtering New algorithms

11 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Data Association and Multi-Target Tracking and ID Great flexibility in representing data association as a problem of inference on a graphical model Distributed fusion naturally leads to sensor- and region-oriented framework Nodes  Sensors, Regions, Groups of targets seen by common set of sensors Variables  Assignments of measurements to regions, targets to regions, measurements to targets Very different from standard MHT Leads naturally to comms-sensitive message- passing and very efficient iterative algorithms

12 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Illustrating comms-sensitive message-passing dynamics Organized network data association Self-organization with region-based representation

13 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Tracking over time and beating the MHT-combinatorial dealer Add nodes that allow us to separate target dynamics from discrete data associations Perform explicit data association within each frame (using evidence from other frames) Stitch across time through temporal dynamics

14 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Dynamic fusion in complex, constrained contexts

15 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Example: Graphical Model for Shape- Tracking with Level Sets

16 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Hierarchical Graphical Models: From Scene/context to objects to parts/shape to features

17 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Determining graphical structure: Capturing statistical links among objects Object 3 tries to interpose itself between objects 1 and 2. The graph describes the state (position) dependency structure.

18 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Modeling Group Interactions

19 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation High-Dimensional, Multi-modal Data Association (c) hue(a) grayscale (b) grayscale (d) img diff

20 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Data Association Example LLR estimates for pair-wise associations (left) Compared to the distribution over the null hypothesis Distribution of full association (middle) Incorrect association likelihood shows some global scene dependence (e.g. due to common lighting changes)

21 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Question #2: Why we think we can beat the dealer The previous examples are not small examples But there is much more that needs to be done to deal with the exponential complexity of the challenges we hope to confront But there is hope…

22 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Recursive Cavity Modeling: Remote Sensing Application

23 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Question #3: What we’ll be doing I: Topics where we’re up and running Scalable, broadly applicable inference algorithms Build on the foundation we have Provide performance bounds/guarantees Provide framework for distributed implementation Including building/learning collaborative fusion algorithms Graphical-model-based methods for sensor fusion for tracking, and identification Will also allow us to incorporate and demonstrate the value of context Graphical models to capture multi-object motion patterns associated with suspicious/threatening activities Graphical models to capture relationships among features-parts- objects

24 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Question #3: What we’ll be doing II: Topics that are on the horizon Learning model structure Discovering links (e.g., detecting coordination) Exploiting and extending advances in learning (e.g., information-theoretic and manifold-learning methods) to build robust models for multimodal fusion Driving the front end Higher-level hypotheses drive signal processing (for feature extraction and to answer “queries”) For example: high-level information on shape, scene, objectives/performance used to guide choice of sparse representation dictionaries Think PEMS: If we’re looking for an anisotropic scatterer in a particular location, guide the front end to do this

25 MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation Question #3: What we’ll be doing III: Topics that are on the horizon (cont.) Informing resource management Using informational structure of a graphical model to decide what evidence to gather What messages should be sent to inform specific hypotheses (information pull rather than push)? What measurements should be taken to reduce critical sources of uncertainty (e.g., at particular graphical nodes)? In distributed processing, dealing with handoff of inference responsibilities Answering these requires information- and graph- theoretic performance bounds