ICDSC 2007 – Vienna, Austria – 25-28 Sept. 2007 1 A Distributed Outdoor Video Surveillance System for Detection of Abnormal.

Slides:



Advertisements
Similar presentations
2.3.3 MAD SAMBA (Multicamera and distributed Surveillance and multisensor-based surveillance) Contact: Alessandro ZANASI zanasi-alessandro.eu.
Advertisements

Agenda.
Bayesian Decision Theory Case Studies
Università degli Studi di Modena e Reggio Emilia Dipartimento di Ingegneria dell’Informazione ImageLab: Attività di ricerca e sviluppo in video-sorveglianza.
Ziming Zhang, Yucheng Zhao and Yiwen Wan.  Introduction&Motivation  Problem Statement  Paper Summeries  Discussion and Conclusions.
Change Detection C. Stauffer and W.E.L. Grimson, “Learning patterns of activity using real time tracking,” IEEE Trans. On PAMI, 22(8): , Aug 2000.
Víctor Ponce Miguel Reyes Xavier Baró Mario Gorga Sergio Escalera Two-level GMM Clustering of Human Poses for Automatic Human Behavior Analysis Departament.
Rear Lights Vehicle Detection for Collision Avoidance Evangelos Skodras George Siogkas Evangelos Dermatas Nikolaos Fakotakis Electrical & Computer Engineering.
Patch to the Future: Unsupervised Visual Prediction
Pedestrian Detection: introduction
Robust Foreground Detection in Video Using Pixel Layers Kedar A. Patwardhan, Guillermoo Sapire, and Vassilios Morellas IEEE TRANSACTION ON PATTERN ANAYLSIS.
Tracking Multiple Occluding People by Localizing on Multiple Scene Planes Professor :王聖智 教授 Student :周節.
Adviser : Ming-Yuan Shieh Student ID : M Student : Chung-Chieh Lien VIDEO OBJECT SEGMENTATION AND ITS SALIENT MOTION DETECTION USING ADAPTIVE BACKGROUND.
A KLT-Based Approach for Occlusion Handling in Human Tracking Chenyuan Zhang, Jiu Xu, Axel Beaugendre and Satoshi Goto 2012 Picture Coding Symposium.
Learning Semantic Scene Models From Observing Activity in Visual Surveillance Dimitios Makris and Tim Ellis (2005) Presented by Steven Wilson.
Hidden Markov Model based 2D Shape Classification Ninad Thakoor 1 and Jean Gao 2 1 Electrical Engineering, University of Texas at Arlington, TX-76013,
Multiple Criteria for Evaluating Land Cover Classification Algorithms Summary of a paper by R.S. DeFries and Jonathan Cheung-Wai Chan April, 2000 Remote.
Modeling Pixel Process with Scale Invariant Local Patterns for Background Subtraction in Complex Scenes (CVPR’10) Shengcai Liao, Guoying Zhao, Vili Kellokumpu,
Report on Intrusion Detection and Data Fusion By Ganesh Godavari.
1 Learning to Detect Objects in Images via a Sparse, Part-Based Representation S. Agarwal, A. Awan and D. Roth IEEE Transactions on Pattern Analysis and.
A Bayesian algorithm for tracking multiple moving objects in outdoor surveillance video Department of Electrical Engineering and Computer Science The University.
Vigilant Real-time storage and intelligent retrieval of visual surveillance data Dr Graeme A. Jones.
1 Integration of Background Modeling and Object Tracking Yu-Ting Chen, Chu-Song Chen, Yi-Ping Hung IEEE ICME, 2006.
CSE 291 Final Project: Adaptive Multi-Spectral Differencing Andrew Cosand UCSD CVRR.
Student: Hsu-Yung Cheng Advisor: Jenq-Neng Hwang, Professor
Effective Gaussian mixture learning for video background subtraction Dar-Shyang Lee, Member, IEEE.
Tracking Video Objects in Cluttered Background
Multi-camera Video Surveillance: Detection, Occlusion Handling, Tracking and Event Recognition Oytun Akman.
Shadow Detection In Video Submitted by: Hisham Abu saleh.
Jacinto C. Nascimento, Member, IEEE, and Jorge S. Marques
Real Time Abnormal Motion Detection in Surveillance Video Nahum Kiryati Tammy Riklin Raviv Yan Ivanchenko Shay Rochel Vision and Image Analysis Laboratory.
Tutorial: multicamera and distributed video surveillance Third ACM/IEEE International Conference on Distributed Smart Cameras.
Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields Yong-Joong Kim Dept. of Computer Science Yonsei.
Anomaly detection with Bayesian networks Website: John Sandiford.
Prakash Chockalingam Clemson University Non-Rigid Multi-Modal Object Tracking Using Gaussian Mixture Models Committee Members Dr Stan Birchfield (chair)
CPSC 601 Lecture Week 5 Hand Geometry. Outline: 1.Hand Geometry as Biometrics 2.Methods Used for Recognition 3.Illustrations and Examples 4.Some Useful.
Similarity measuress Laboratory of Image Analysis for Computer Vision and Multimedia Università di Modena e Reggio Emilia,
1. Introduction Motion Segmentation The Affine Motion Model Contour Extraction & Shape Estimation Recursive Shape Estimation & Motion Estimation Occlusion.
Learning and Recognizing Human Dynamics in Video Sequences Christoph Bregler Alvina Goh Reading group: 07/06/06.
A General Framework for Tracking Multiple People from a Moving Camera
Bayesian networks Classification, segmentation, time series prediction and more. Website: Twitter:
Report on Intrusion Detection and Data Fusion By Ganesh Godavari.
Jhih-sin Jheng 2009/09/01 Machine Learning and Bioinformatics Laboratory.
Using Inactivity to Detect Unusual behavior Presenter : Siang Wang Advisor : Dr. Yen - Ting Chen Date : Motion and video Computing, WMVC.
Hierarchical Method for Foreground DetectionUsing Codebook Model Jing-Ming Guo, Yun-Fu Liu, Chih-Hsien Hsia, Min-Hsiung Shih, and Chih-Sheng Hsu IEEE TRANSACTIONS.
Introduction to Video Background Subtraction 1. Motivation In video action analysis, there are many popular applications like surveillance for security,
Vehicle Segmentation and Tracking From a Low-Angle Off-Axis Camera Neeraj K. Kanhere Committee members Dr. Stanley Birchfield Dr. Robert Schalkoff Dr.
1 Research Question  Can a vision-based mobile robot  with limited computation and memory,  and rapidly varying camera positions,  operate autonomously.
Action and Gait Recognition From Recovered 3-D Human Joints IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS— PART B: CYBERNETICS, VOL. 40, NO. 4, AUGUST.
Robust Object Tracking by Hierarchical Association of Detection Responses Present by fakewen.
Expectation-Maximization (EM) Case Studies
Raquel A. Romano 1 Scientific Computing Seminar May 12, 2004 Projective Geometry for Computer Vision Projective Geometry for Computer Vision Raquel A.
Sparse Bayesian Learning for Efficient Visual Tracking O. Williams, A. Blake & R. Cipolloa PAMI, Aug Presented by Yuting Qi Machine Learning Reading.
The geometry of the system consisting of the hyperbolic mirror and the CCD camera is shown to the right. The points on the mirror surface can be expressed.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Supervised Learning Resources: AG: Conditional Maximum Likelihood DP:
Final Review Course web page: vision.cis.udel.edu/~cv May 21, 2003  Lecture 37.
 Present by 陳群元.  Introduction  Previous work  Predicting motion patterns  Spatio-temporal transition distribution  Discerning pedestrians  Experimental.
Using Adaptive Tracking To Classify And Monitor Activities In A Site W.E.L. Grimson, C. Stauffer, R. Romano, L. Lee.
Discriminative Training and Machine Learning Approaches Machine Learning Lab, Dept. of CSIE, NCKU Chih-Pin Liao.
Tracking Groups of People for Video Surveillance Xinzhen(Elaine) Wang Advisor: Dr.Longin Latecki.
Cell Segmentation in Microscopy Imagery Using a Bag of Local Bayesian Classifiers Zhaozheng Yin RI/CMU, Fall 2009.
IEEE AI - BASED POWER SYSTEM TRANSIENT SECURITY ASSESSMENT Dr. Hossam Talaat Dept. of Electrical Power & Machines Faculty of Engineering - Ain Shams.
Learning and Removing Cast Shadows through a Multidistribution Approach Nicolas Martel-Brisson, Andre Zaccarin IEEE TRANSACTIONS ON PATTERN ANALYSIS AND.
Bayesian Decision Theory Case Studies CS479/679 Pattern Recognition Dr. George Bebis.
Detecting Moving Objects, Ghosts, and Shadows in Video Streams
Learning Patterns of Activity
A Forest of Sensors: Using adaptive tracking to classify and monitor activities in a site Eric Grimson AI Lab, Massachusetts Institute of Technology
A New Approach to Track Multiple Vehicles With the Combination of Robust Detection and Two Classifiers Weidong Min , Mengdan Fan, Xiaoguang Guo, and Qing.
Vehicle Segmentation and Tracking in the Presence of Occlusions
Eric Grimson, Chris Stauffer,
Presentation transcript:

ICDSC 2007 – Vienna, Austria – Sept A Distributed Outdoor Video Surveillance System for Detection of Abnormal People Trajectories Simone Calderara, Rita Cucchiara, Andrea Prati Imagelab laboratory University of Modena and Reggio Emilia, Italy

ICDSC 2007 – Vienna, Austria – Sept Agenda Motivations The IMAGELAB distributed video surveillance system Motion detection and tracking Multi-camera consistent labeling Probabilistic people trajectory classification Conclusions Motivations

ICDSC 2007 – Vienna, Austria – Sept Motivations Video surveillance: why? –Increasing security level of public places –Crime Prevention … Why automated video surveillance? –Manual monitoring of large areas is difficult –Humans typically focus their attention on particular spots (some others may not be observed) –Interesting information may be extracted and stored for subsequent analysis (posterity logging for forensic off-line analysis)

ICDSC 2007 – Vienna, Austria – Sept Motivations (2) Distributed multiple cameras mean: –Wider coverage of the scene –Redundant data (improved accuracy) –Different viewpoints disambiguate groups, help with occlusions Distributed multiple cameras - disadvantages: –System complexity can seriously rise with many cameras –Using multiple cameras is almost useless if data from different cameras are not correlated –Need for camera communication/coordination

ICDSC 2007 – Vienna, Austria – Sept Motivations (3) Previous generations of automatic surveillance systems are focused on robustly performing low-level tasks (motion detection, segmentation, perimeter control,…) Next generations will need to operate at a higher level of abstraction (infer or learn behavioral patterns, detect specific behaviors, understand what is happening in the scene,…)

ICDSC 2007 – Vienna, Austria – Sept Agenda Motivations The IMAGELAB distributed video surveillance system Motion detection and tracking Multi-camera consistent labeling Probabilistic people trajectory classification Conclusions Motivations The IMAGELAB distributed video surveillance system

ICDSC 2007 – Vienna, Austria – Sept IMAGELAB VS system Sakbot Ad hoc Hecol PPC Projects and prototypes since 1998

ICDSC 2007 – Vienna, Austria – Sept Park experimentation (LAICA Project Reggio Emilia)

ICDSC 2007 – Vienna, Austria – Sept Agenda Motivations The IMAGELAB distributed video surveillance system Motion detection and tracking Multi-camera consistent labeling Probabilistic people trajectory classification Experiments Conclusions Motivations The IMAGELAB distributed video surveillance system Motion detection and tracking

ICDSC 2007 – Vienna, Austria – Sept Motion detection SAKBOT based on temporal median + selective knowledge-based updating Suitable modifications of SAKBOT [1] system to deal with outdoor requirements: –Bootstrapping: initial bkg model created using single difference at block-level (16x16) –Adaptive bkg differencing: hysteresis (local and pixel- varying) thresholding of the bkg difference [1] R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, “Detecting moving objects, ghosts and shadows in video streams,” IEEE Trans. on PAMI, vol. 25, no. 10, pp. 1337–1342, Oct

ICDSC 2007 – Vienna, Austria – Sept Motion detection (2) SAKBOT’s modifications (cont’d): –Fast “ghost” suppression: similar to bootstrapping (based on single difference), but at region-level: valid object only if a sufficient number of pixels are moving –Others: object validation, shadow suppression, …

ICDSC 2007 – Vienna, Austria – Sept Object tracking Apperance-based tracking approaches keep track not only of the state but also of the shape at pixel- level, necessary for gait or posture analysis AD-HOC (Appearance Driven Human tracking with Occlusion Classification) [2] based not only on object’s position and speed, but also on its appearance map and probability mask [2] R. Vezzani, C. Grana, R. Cucchiara, “AD-HOC: Appearance Driven Human tracking with Occlusion Classification”, under review in Pattern Recognition, 2007

ICDSC 2007 – Vienna, Austria – Sept Agenda Motivations The IMAGELAB distributed video surveillance system Motion detection and tracking Multi-camera consistent labeling Probabilistic people trajectory classification Conclusions Motivations The IMAGELAB distributed video surveillance system Motion detection and tracking Multi-camera consistent labeling

ICDSC 2007 – Vienna, Austria – Sept [3] S. CALDERARA, R. CUCCHIARA, PRATI A. Bayesian-competitive Consistent Labeling for People Surveillance. In press on IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Multi-camera consistent labeling Consistent labeling allows to assign the same label to different instances of the same person in different cameras Consistent labeling can be exploited not only for people tracking on wide scenes, but also for posterity logging; multiple views of the same person exploited to improve retrieval for post-analysis HECOL (Homography and Epipolar-based Consistent Labeling): pure geometrical approach [3]

ICDSC 2007 – Vienna, Austria – Sept The HECOL system

ICDSC 2007 – Vienna, Austria – Sept The HECOL system (2) Off-line process automatically computes ground- plane homography and epipolar constraints correct correspondence On-line process employs Bayesian-competitive approach with warping of vertical axis and a two- contributions check a2ja2j a1ja1j homography epipolar geometry FG MAP label assignment:

ICDSC 2007 – Vienna, Austria – Sept Agenda Motivations The IMAGELAB distributed video surveillance system Motion detection and tracking Multi-camera consistent labeling Probabilistic people trajectory classification Conclusions Motivations The IMAGELAB distributed video surveillance system Motion detection and tracking Multi-camera consistent labeling Probabilistic people trajectory classification

ICDSC 2007 – Vienna, Austria – Sept Trajectory acquisition

ICDSC 2007 – Vienna, Austria – Sept Path modeling Each trajectory is encoded as a sequence of directions: Each trajectory is modeled as a Von Mises distribution where I 0 is modified zero-order Bessel function of the first kind. The Von Mises parameters are learnt through ML estimator:

ICDSC 2007 – Vienna, Austria – Sept Learning phase A training set of trajectories has been collected: 88 trajectories to train the classifier and model the concept of normality Aiming at clustering similar trajectories, not similar directions Parameters’ space clustered with k-medoids, because it is not Euclidean; specific distance metric based on Bhattacharyya distance Analytical and closed-form expression derived for two Von Mises distributions:

ICDSC 2007 – Vienna, Austria – Sept Clustering trajectories

ICDSC 2007 – Vienna, Austria – Sept Clustering trajectories (2) The medoids constitute the model of normal behavior and are used to build a multimodal mixture distribution of “normality”: –The final distribution is a mixture of Von Mises distribution –The components are the Von Mises pdf of each medoid. –The weights of each component is proportional to the number of training trajectories that fall into a specific cluster –The influence of abnormal trajectories acquired during training is smoothed by clustering and mixture component weighting coefficients

ICDSC 2007 – Vienna, Austria – Sept Testing phase Classification of a new path T j is performed by a two- steps approach that: –first selects the best candidate model among the available medoids –and subsequently tests its fitness with the observed data First stepSecond step

ICDSC 2007 – Vienna, Austria – Sept Testing phase (2) Model selection exploiting MAP framework to maximize the model’s parameters posterior over the observed path directions (a discrete hidden 1-of-K variable Z is introduced) After the evaluation, the desired model parameters are selected according to the Z i value that maximizes the posterior:

ICDSC 2007 – Vienna, Austria – Sept Testing phase (3) After the selection of the model, the path is verified against the model using a first-order Bayesian network : Right side decoupled in two contributions, the first coming by the fitness of the variable against the selected model and the second coming from the range of variability with respect to the previous observed value:

ICDSC 2007 – Vienna, Austria – Sept Results for path classification Testing: more than two hours of logging, two sets (of 121 and 135 trajectories) Ground truths based on judges of experts. The experts divided the trajectories into 95 abnormal and 161 normal. The classification rate is 100% for abnormal and 97.5% for normal. It is important to observe that the system correctly detects all the abnormal trajectories generating only false warnings in the case of normal behavior erroneously classified.

ICDSC 2007 – Vienna, Austria – Sept Conclusions Complete system for distributed video surveillance presented Single steps commented and results shown Details on high-level trajectory classification for abnormal path detection The overall system has been deeply tested on campus-based controlled scenario Preliminary setup on park (uncontrolled) scenario shows promising results

ICDSC 2007 – Vienna, Austria – Sept Thank you!! 28

ICDSC 2007 – Vienna, Austria – Sept