Goal: Fast and Robust Velocity Estimation P1P1 P2P2 P3P3 P4P4 Our Approach: Alignment Probability ●Spatial Distance ●Color Distance (if available) ●Probability.

Slides:



Advertisements
Similar presentations
IEEE CDC Nassau, Bahamas, December Integration of shape constraints in data association filters Integration of shape constraints in data.
Advertisements

Bayesian Belief Propagation
Probabilistic Tracking and Recognition of Non-rigid Hand Motion
CSCE643: Computer Vision Bayesian Tracking & Particle Filtering Jinxiang Chai Some slides from Stephen Roth.
Introduction To Tracking
Hybrid Position-Based Visual Servoing
Parallel Tracking and Mapping for Small AR Workspaces Vision Seminar
(Includes references to Brian Clipp
Vision Based Control Motion Matt Baker Kevin VanDyke.
Real Time Motion Capture Using a Single Time-Of-Flight Camera
Robust Object Tracking via Sparsity-based Collaborative Model
Multiple People Detection and Tracking with Occlusion Presenter: Feifei Huo Supervisor: Dr. Emile A. Hendriks Dr. A. H. J. Stijn Oomes Information and.
Presenter: David Fleeman { D. Juedes, F. Drews, L. Welch and D. Fleeman Center for Intelligent, Distributed & Dependable.
Introduction to Mobile Robotics Bayes Filter Implementations Gaussian filters.
Formation et Analyse d’Images Session 8
Sam Pfister, Stergios Roumeliotis, Joel Burdick
Probabilistic Robotics: Kalman Filters
Project Progress Presentation Coffee delivery mission Dec, 10, 2007 NSH 3211 Hyun Soo Park, Iacopo Gentilini 1.
Tracking Objects with Dynamics Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 04/21/15 some slides from Amin Sadeghi, Lana Lazebnik,
Adam Rachmielowski 615 Project: Real-time monocular vision-based SLAM.
1 Distributed localization of networked cameras Stanislav Funiak Carlos Guestrin Carnegie Mellon University Mark Paskin Stanford University Rahul Sukthankar.
Stanford CS223B Computer Vision, Winter 2007 Lecture 12 Tracking Motion Professors Sebastian Thrun and Jana Košecká CAs: Vaibhav Vaish and David Stavens.
Adaptive Rao-Blackwellized Particle Filter and It’s Evaluation for Tracking in Surveillance Xinyu Xu and Baoxin Li, Senior Member, IEEE.
SLAM: Simultaneous Localization and Mapping: Part I Chang Young Kim These slides are based on: Probabilistic Robotics, S. Thrun, W. Burgard, D. Fox, MIT.
Probabilistic Robotics
Robust Monte Carlo Localization for Mobile Robots
Tracking using the Kalman Filter. Point Tracking Estimate the location of a given point along a sequence of images. (x 0,y 0 ) (x n,y n )
1 Integration of Background Modeling and Object Tracking Yu-Ting Chen, Chu-Song Chen, Yi-Ping Hung IEEE ICME, 2006.
Visual Odometry for Ground Vehicle Applications David Nister, Oleg Naroditsky, James Bergen Sarnoff Corporation, CN5300 Princeton, NJ CPSC 643, Presentation.
Stanford CS223B Computer Vision, Winter 2007 Lecture 12 Tracking Motion Professors Sebastian Thrun and Jana Košecká CAs: Vaibhav Vaish and David Stavens.
Presented by Pat Chan Pik Wah 28/04/2005 Qualifying Examination
Bayesian Filtering for Location Estimation D. Fox, J. Hightower, L. Liao, D. Schulz, and G. Borriello Presented by: Honggang Zhang.
1 Formation et Analyse d’Images Session 7 Daniela Hall 7 November 2005.
BraMBLe: The Bayesian Multiple-BLob Tracker By Michael Isard and John MacCormick Presented by Kristin Branson CSE 252C, Fall 2003.
Exploiting video information for Meeting Structuring ….
Human-Computer Interaction Human-Computer Interaction Tracking Hanyang University Jong-Il Park.
1. Introduction Motion Segmentation The Affine Motion Model Contour Extraction & Shape Estimation Recursive Shape Estimation & Motion Estimation Occlusion.
A General Framework for Tracking Multiple People from a Moving Camera
Simultaneous Localization and Mapping Presented by Lihan He Apr. 21, 2006.
Dynamic 3D Scene Analysis from a Moving Vehicle Young Ki Baik (CV Lab.) (Wed)
Loris Bazzani*, Marco Cristani*†, Vittorio Murino*† Speaker: Diego Tosato* *Computer Science Department, University of Verona, Italy †Istituto Italiano.
Young Ki Baik, Computer Vision Lab.
Stereo Object Detection and Tracking Using Clustering and Bayesian Filtering Texas Tech University 2011 NSF Research Experiences for Undergraduates Site.
Enforcing Constraints for Human Body Tracking David Demirdjian Artificial Intelligence Laboratory, MIT.
Learning the Appearance and Motion of People in Video Hedvig Sidenbladh, KTH Michael Black, Brown University.
Visual SLAM Visual SLAM SPL Seminar (Fri) Young Ki Baik Computer Vision Lab.
Automated Intruder Tracking using Particle Filtering and a Network of Binary Motion Sensors Jeremy Schiff EECS Department University of California, Berkeley.
21 June 2009Robust Feature Matching in 2.3μs1 Simon Taylor Edward Rosten Tom Drummond University of Cambridge.
Stable Multi-Target Tracking in Real-Time Surveillance Video
Crowd Analysis at Mass Transit Sites Prahlad Kilambi, Osama Masound, and Nikolaos Papanikolopoulos University of Minnesota Proceedings of IEEE ITSC 2006.
Chapter 5 Multi-Cue 3D Model- Based Object Tracking Geoffrey Taylor Lindsay Kleeman Intelligent Robotics Research Centre (IRRC) Department of Electrical.
Lesson 2 – kalman Filters
Boosted Particle Filter: Multitarget Detection and Tracking Fayin Li.
Looking at people and Image-based Localisation Roberto Cipolla Department of Engineering Research team
Real-Time Tracking with Mean Shift Presented by: Qiuhua Liu May 6, 2005.
Vision-based SLAM Enhanced by Particle Swarm Optimization on the Euclidean Group Vision seminar : Dec Young Ki BAIK Computer Vision Lab.
Tracking with dynamics
Visual Odometry for Ground Vehicle Applications David Nistér, Oleg Naroditsky, and James Bergen Sarnoff Corporation CN5300 Princeton, New Jersey
Monte Carlo Localization for Mobile Robots Frank Dellaert 1, Dieter Fox 2, Wolfram Burgard 3, Sebastian Thrun 4 1 Georgia Institute of Technology 2 University.
Zhaoxia Fu, Yan Han Measurement Volume 45, Issue 4, May 2012, Pages 650–655 Reporter: Jing-Siang, Chen.
Learning Image Statistics for Bayesian Tracking Hedvig Sidenbladh KTH, Sweden Michael Black Brown University, RI, USA
Vision-based Android Application for GPS Assistance in Tunnels
Signal and Image Processing Lab
Paper – Stephen Se, David Lowe, Jim Little
Contents Team introduction Project Introduction Applicability
C. Canton1, J.R. Casas1, A.M.Tekalp2, M.Pardàs1
Tracking Objects with Dynamics
Combining Geometric- and View-Based Approaches for Articulated Pose Estimation David Demirdjian MIT Computer Science and Artificial Intelligence Laboratory.
A Short Introduction to the Bayes Filter and Related Models
Nome Sobrenome. Time time time time time time..
Presentation transcript:

Goal: Fast and Robust Velocity Estimation P1P1 P2P2 P3P3 P4P4 Our Approach: Alignment Probability ●Spatial Distance ●Color Distance (if available) ●Probability of Occlusion Annealed Dynamic Histograms Combining 3D Shape, Color, and Motion for Robust Anytime Tracking David Held, Jesse Levinson, Sebastian Thrun, and Silvio Savarese

Goal: Fast and Robust Velocity Estimation Combining 3D Shape, Color, and Motion for Robust Anytime Tracking David Held, Jesse Levinson, Sebastian Thrun, and Silvio Savarese Baseline: Centroid Kalman Filter Local Search Poor Local Optimum! t+1t Baseline: ICP Annealed Dynamic Histograms

Goal: Fast and Robust Velocity Estimation P1P1 P2P2 P3P3 P4P4 Our Approach: Alignment Probability ●Spatial Distance ●Color Distance (if available) ●Probability of Occlusion Combining 3D Shape, Color, and Motion for Robust Anytime Tracking David Held, Jesse Levinson, Sebastian Thrun, and Silvio Savarese Annealed Dynamic Histograms

Motivation Quickly and robustly estimate the speed of nearby objects

Laser Data Camera Images System

Laser Data Camera Images System Previous Work (Teichman, et al)

System Laser Data Camera Images This Work Velocity Estimation Previous Work (Teichman, et al)

Velocity Estimation t

t+1t

Velocity Estimation t+1t

Velocity Estimation t+1t

Velocity Estimation t+1t

ICP Baseline

Local Search Poor Local Optimum! ICP Baseline

Tracking Probability

Velocity Estimation t

t+1t

Velocity Estimation t+1t

Velocity Estimation t+1t

Velocity Estimation t+1t

Velocity Estimation t+1t

Velocity Estimation t+1t XtXt

Velocity Estimation t+1t XtXt

Measurement Model Motion Model Tracking Probability

Measurement Model Motion Model Tracking Probability Constant velocity Kalman filter

Measurement Model Tracking Probability Motion Model

Measurement Model Tracking Probability Motion Model

Measurement Model Tracking Probability Motion Model

Measurement Model Tracking Probability Motion Model

Measurement Model Tracking Probability Motion Model

Measurement Model Tracking Probability Motion Model

Measurement Model Tracking Probability Motion Model

Measurement Model Tracking Probability Motion Model

Measurement Model Tracking Probability Motion Model

Measurement Model Tracking Probability Motion Model

Measurement Model Tracking Probability Motion Model

Measurement Model Tracking Probability Motion Model k

Measurement Model Tracking Probability Motion Model Sensor noise Sensor resolution k

Delta Color Value Probability Color Probability

Including Color

Delta Color Value Probability

Including Color Delta Color Value Probability

Including Color Delta Color Value Probability

Probabilistic Framework 3D Shape Color Tracking Motion History

Tracking Probability P1P1 P2P2 P3P3 P4P4

vyvy vxvx ? ? ? ? ?

vyvy vxvx

Dynamic Decomposition vyvy vxvx

vyvy vxvx

vyvy vxvx

vyvy vxvx Derived from minimizing KL-divergence between approximate distribution and true posterior

Annealing Inflate the measurement model

Annealing Inflate the measurement model

Annealing Inflate the measurement model

Algorithm 1.For each hypothesis A.Compute the probability of the alignment Measurement Model Motion Model

Algorithm 1.For each hypothesis A.Compute the probability of the alignment B.Finely sample high probability regions Measurement Model Motion Model

Algorithm 1.For each hypothesis A.Compute the probability of the alignment B.Finely sample high probability regions C.Go to step 1 to compute the probability of new hypotheses Measurement Model Motion Model

Annealing More time More accurate

Anytime Tracker

Choose runtime based on: Total runtime requirements Importance of tracked object...

Comparisons

Kalman Filter

Kalman Filter ADH Tracker (Ours)

Models

Quantitative Evaluation 2

Sampling Strategies

Advantages over Radar

Conclusions 3D Shape Color Tracking Motion History ●Robust to Occlusions, Viewpoint Changes

Conclusions 3D Shape Color Tracking Motion History ●Robust to Occlusions, Viewpoint Changes ●Runs in Real-time ●Robust to Initialization Errors

Delta Color Value Probability Color Probability

Error vs Number of Points

Error vs Distance

Error vs Number of Frames