IEEE CDC Nassau, Bahamas, December Integration of shape constraints in data association filters Integration of shape constraints in data association filters Giambattista Gennari, Alessandro Chiuso, Fabio Cuzzolin, Ruggero Frezza University of Padova

IEEE CDC Nassau, Bahamas, December Outline of the Talk Tracking and Data Association Classical solution: independent dynamics Our approach : integration of shape Occlusions Experiments

IEEE CDC Nassau, Bahamas, December Tracking and Data Association PROBLEM: PROBLEM: Set of targets generating UNLABELLED measurements Associate and Track Occlusions Clutter

IEEE CDC Nassau, Bahamas, December SHAPE AND COORDINATION Motion invariant properties of targets: Rigid or Articulated bodies Formations of vehicles (Flock of birds) Deformable objects Distances and/or angles Connectivity – distances Relative velocity Group of admissible deformations (probabilistic or deterministic)

IEEE CDC Nassau, Bahamas, December Probabilistic Tracking and Data Association CLASSICALLY: JPDAF – MHT JPDAF – MHT + Dynamical Models Dynamical Models Full (joint) model -not flexible -computationally expensive Model targets Independently -flexible and easy -not robust occlusions exchange tracks OUR APPROACH: JPDAF- (MHT) + Independent Dynamical Models + Shape Information + Flexible + Robust to occlusions and track proximity - Computation (Monte Carlo)

IEEE CDC Nassau, Bahamas, December Independent Motion Targets are described by independent dynamics Flexible and easy Lack of robustness in presence of occlusions, false detections and closely spaced targets Index of Target

IEEE CDC Nassau, Bahamas, December Associations An association is a map matching unlabelled measurements to targets Employ the overall model to compute the probability of each association Association MeasurementsMeasurements matched to clutter Measurements matched to targets

IEEE CDC Nassau, Bahamas, December Description of Shape Probabilistic Model Example: pairwise distances of non perfectly rigid bodies Motion Invariant Prior Knowledge Learn from Data Targets positions

IEEE CDC Nassau, Bahamas, December Shape Integration We assume the overall model can be factored into two terms describing the mutual configuration and single target dynamics Kalman filters and independent dynamical models Shape constraints

IEEE CDC Nassau, Bahamas, December Occlusions To compute marginalize over the occluded : Detected pointsMissing points (occlusions) Compute the integral through Monte Carlo techniques

IEEE CDC Nassau, Bahamas, December Monte Carlo Integration Sample: Weight: Integrate: Fair sample from the posterior

IEEE CDC Nassau, Bahamas, December Summary Conditional state estimates SHAPE INDEPENDENT KALMAN FILTERS T1TNT2 …. Monte Carlo fair samples for occluded points state estimation OVERALL MODEL Association probabilities Measurements

IEEE CDC Nassau, Bahamas, December State Estimation An overall state estimate can be obtained summing the conditional state estimates weighted by the corresponding association probabilities Alternatively, several state estimates can be propagated over time (multi hypothesis tracker ) Necessary in the learning phase !

IEEE CDC Nassau, Bahamas, December Results Real data from a motion capture system Rapid motion High numbers of false detections Occlusions lasting several frames

IEEE CDC Nassau, Bahamas, December Results Commercial system: looses and confuses tracks With shape knowledge learned from data

IEEE CDC Nassau, Bahamas, December Conclusions Algorithm for integrating shape knowledge into data association filter Robust in presence of occlusions and clutter Provide a framework for learning shape models (this requires use of multiple hypothesis kind of algorithms) (In the example shape was learned from data)

IEEE CDC Nassau, Bahamas, December

IEEE CDC Nassau, Bahamas, December Shape Constraints In many cases, coordinated points exhibit properties which are invariant with respect to their motion, they satisfy some sort of shape constraints: – pairwise distances of rigidly linked points are constant – the position and velocity of a point moving in group are similar to those of its neighbors

IEEE CDC Nassau, Bahamas, December Coordinated Motion Rigid motion Articulated bodies, Groups of people moving together, Formations Taking into account coordination improves tracking robustness We describe shape and motion separately and combine them together ( more flexible than joint models )