A KLT-Based Approach for Occlusion Handling in Human Tracking Chenyuan Zhang, Jiu Xu, Axel Beaugendre and Satoshi Goto 2012 Picture Coding Symposium.

Slides:



Advertisements
Similar presentations
People Counting and Human Detection in a Challenging Situation Ya-Li Hou and Grantham K. H. Pang IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS—PART.
Advertisements

CSCE643: Computer Vision Bayesian Tracking & Particle Filtering Jinxiang Chai Some slides from Stephen Roth.
Loris Bazzani*, Marco Cristani*†, Alessandro Perina*, Michela Farenzena*, Vittorio Murino*† *Computer Science Department, University of Verona, Italy †Istituto.
Wrist Recognition and the Center of the Palm Estimation Based on Depth Camera Zhengwei Yao ; Zhigeng Pan ; Shuchang Xu Virtual Reality and Visualization.
Xin Zhang, Zhichao Ye, Lianwen Jin, Ziyong Feng, and Shaojie Xu
Activity Recognition Aneeq Zia. Agenda What is activity recognition Typical methods used for action recognition “Evaluation of local spatio-temporal features.
Real-Time Accurate Stereo Matching using Modified Two-Pass Aggregation and Winner- Take-All Guided Dynamic Programming Xuefeng Chang, Zhong Zhou, Yingjie.
Tracking Multiple Occluding People by Localizing on Multiple Scene Planes Professor :王聖智 教授 Student :周節.
Forward-Backward Correlation for Template-Based Tracking Xiao Wang ECE Dept. Clemson University.
Object Inter-Camera Tracking with non- overlapping views: A new dynamic approach Trevor Montcalm Bubaker Boufama.
Robust Object Tracking via Sparsity-based Collaborative Model
Multiple People Detection and Tracking with Occlusion Presenter: Feifei Huo Supervisor: Dr. Emile A. Hendriks Dr. A. H. J. Stijn Oomes Information and.
Recognition of Traffic Lights in Live Video Streams on Mobile Devices
Modeling Pixel Process with Scale Invariant Local Patterns for Background Subtraction in Complex Scenes (CVPR’10) Shengcai Liao, Guoying Zhao, Vili Kellokumpu,
Tracking Objects with Dynamics Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 04/21/15 some slides from Amin Sadeghi, Lana Lazebnik,
A Bayesian algorithm for tracking multiple moving objects in outdoor surveillance video Department of Electrical Engineering and Computer Science The University.
Multiple Human Objects Tracking in Crowded Scenes Yao-Te Tsai, Huang-Chia Shih, and Chung-Lin Huang Dept. of EE, NTHU International Conference on Pattern.
1 Integration of Background Modeling and Object Tracking Yu-Ting Chen, Chu-Song Chen, Yi-Ping Hung IEEE ICME, 2006.
Novel Self-Configurable Positioning Technique for Multihop Wireless Networks Authors : Hongyi Wu Chong Wang Nian-Feng Tzeng IEEE/ACM TRANSACTIONS ON NETWORKING,
Effective Gaussian mixture learning for video background subtraction Dar-Shyang Lee, Member, IEEE.
Tracking Video Objects in Cluttered Background
A Probabilistic Framework For Segmentation And Tracking Of Multiple Non Rigid Objects For Video Surveillance Aleksandar Ivanovic, Tomas S. Huang ICIP 2004.
Multi-camera Video Surveillance: Detection, Occlusion Handling, Tracking and Event Recognition Oytun Akman.
A Real-Time for Classification of Moving Objects
Introduction to Object Tracking Presented by Youyou Wang CS643 Texas A&M University.
Dorin Comaniciu Visvanathan Ramesh (Imaging & Visualization Dept., Siemens Corp. Res. Inc.) Peter Meer (Rutgers University) Real-Time Tracking of Non-Rigid.
IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 20, NO. 11, NOVEMBER 2011 Qian Zhang, King Ngi Ngan Department of Electronic Engineering, the Chinese university.
Jacinto C. Nascimento, Member, IEEE, and Jorge S. Marques
Real-Time Decentralized Articulated Motion Analysis and Object Tracking From Videos Wei Qu, Member, IEEE, and Dan Schonfeld, Senior Member, IEEE.
REALTIME OBJECT-OF-INTEREST TRACKING BY LEARNING COMPOSITE PATCH-BASED TEMPLATES Yuanlu Xu, Hongfei Zhou, Qing Wang*, Liang Lin Sun Yat-sen University,
Dept. of ECE 1 Feature-based Object Tracking Dr. Dapeng Oliver Wu Joint Work with Bing Han, William Roberts, and Jian Li Department of Electrical and Computer.
Jason Li Jeremy Fowers Ground Target Following for Unmanned Aerial Vehicles.
1 Activity and Motion Detection in Videos Longin Jan Latecki and Roland Miezianko, Temple University Dragoljub Pokrajac, Delaware State University Dover,
Tracking Pedestrians Using Local Spatio- Temporal Motion Patterns in Extremely Crowded Scenes Louis Kratz and Ko Nishino IEEE TRANSACTIONS ON PATTERN ANALYSIS.
New Segmentation Methods Advisor : 丁建均 Jian-Jiun Ding Presenter : 蔡佳豪 Chia-Hao Tsai Date: Digital Image and Signal Processing Lab Graduate Institute.
Robust Hand Tracking with Refined CAMShift Based on Combination of Depth and Image Features Wenhuan Cui, Wenmin Wang, and Hong Liu International Conference.
Prakash Chockalingam Clemson University Non-Rigid Multi-Modal Object Tracking Using Gaussian Mixture Models Committee Members Dr Stan Birchfield (chair)
Olga Zoidi, Anastasios Tefas, Member, IEEE Ioannis Pitas, Fellow, IEEE
Mean-shift and its application for object tracking
Shape-Based Human Detection and Segmentation via Hierarchical Part- Template Matching Zhe Lin, Member, IEEE Larry S. Davis, Fellow, IEEE IEEE TRANSACTIONS.
Brian Renzenbrink Jeff Robble Object Tracking Using the Extended Kalman Particle Filter.
1. Introduction Motion Segmentation The Affine Motion Model Contour Extraction & Shape Estimation Recursive Shape Estimation & Motion Estimation Occlusion.
A General Framework for Tracking Multiple People from a Moving Camera
Loris Bazzani*, Marco Cristani*†, Vittorio Murino*† Speaker: Diego Tosato* *Computer Science Department, University of Verona, Italy †Istituto Italiano.
Marco Pedersoli, Jordi Gonzàlez, Xu Hu, and Xavier Roca
An Information Fusion Approach for Multiview Feature Tracking Esra Ataer-Cansizoglu and Margrit Betke ) Image and.
1 Webcam Mouse Using Face and Eye Tracking in Various Illumination Environments Yuan-Pin Lin et al. Proceedings of the 2005 IEEE Y.S. Lee.
Mentor: Salman Khokhar Action Recognition in Crowds Week 7.
A New Fingertip Detection and Tracking Algorithm and Its Application on Writing-in-the-air System The th International Congress on Image and Signal.
Tracking People by Learning Their Appearance Deva Ramanan David A. Forsuth Andrew Zisserman.
Bryan Willimon, Stan Birchfield, Ian Walker Department of Electrical and Computer Engineering Clemson University IROS 2010 Rigid and Non-Rigid Classification.
A Region Based Stereo Matching Algorithm Using Cooperative Optimization Zeng-Fu Wang, Zhi-Gang Zheng University of Science and Technology of China Computer.
Stable Multi-Target Tracking in Real-Time Surveillance Video
Expectation-Maximization (EM) Case Studies
Chapter 5 Multi-Cue 3D Model- Based Object Tracking Geoffrey Taylor Lindsay Kleeman Intelligent Robotics Research Centre (IRRC) Department of Electrical.
Fast and Robust Algorithm of Tracking Multiple Moving Objects for Intelligent Video Surveillance Systems Jong Sun Kim, Dong Hae Yeom, and Young Hoon Joo,2011.
Jiu XU, Axel BEAUGENDRE and Satoshi GOTO Computer Sciences and Convergence Information Technology (ICCIT), th International Conference on 1 Real-time.
Boosted Particle Filter: Multitarget Detection and Tracking Fayin Li.
Implementation, Comparison and Literature Review of Spatio-temporal and Compressed domains Object detection. By Gokul Krishna Srinivasan Submitted to Dr.
Looking at people and Image-based Localisation Roberto Cipolla Department of Engineering Research team
Real-Time Tracking with Mean Shift Presented by: Qiuhua Liu May 6, 2005.
 Present by 陳群元.  Introduction  Previous work  Predicting motion patterns  Spatio-temporal transition distribution  Discerning pedestrians  Experimental.
Robust Nighttime Vehicle Detection by Tracking and Grouping Headlights Qi Zou, Haibin Ling, Siwei Luo, Yaping Huang, and Mei Tian.
Max-Confidence Boosting With Uncertainty for Visual tracking WEN GUO, LIANGLIANG CAO, TONY X. HAN, SHUICHENG YAN AND CHANGSHENG XU IEEE TRANSACTIONS ON.
Zhaoxia Fu, Yan Han Measurement Volume 45, Issue 4, May 2012, Pages 650–655 Reporter: Jing-Siang, Chen.
Ehsan Nateghinia Hadi Moradi (University of Tehran, Tehran, Iran) Video-Based Multiple Vehicle Tracking at Intersections.
A New Approach to Track Multiple Vehicles With the Combination of Robust Detection and Two Classifiers Weidong Min , Mengdan Fan, Xiaoguang Guo, and Qing.
Presented by: Yang Yu Spatiotemporal GMM for Background Subtraction with Superpixel Hierarchy Mingliang Chen, Xing Wei, Qingxiong.
PRAKASH CHOCKALINGAM, NALIN PRADEEP, AND STAN BIRCHFIELD
Introduction to Object Tracking
Presentation transcript:

A KLT-Based Approach for Occlusion Handling in Human Tracking Chenyuan Zhang, Jiu Xu, Axel Beaugendre and Satoshi Goto 2012 Picture Coding Symposium

Outline Introduction Related Work Proposed Approach Experimental Result Conclusion 2

Introduction Among the area of the tracking algorithms, the particle filtering approach is playing a significant role. Particle filter based tracking algorithms have suffered from occlusion, large deformation of the target objects and illumination changes. 3

Cont. Several new methods [1,2] added to the particle filter to overcome these kind of problems. Our proposal is mainly focused on the occlusion problem during human tracking. 4 [1] H. Wang, X. Hou, and C. Liu, “Object Tracking by Bidirectional Learning with Feature selection”, IEEE International Conference on Image Processing, 2009, pp [2] J. Pan and B. Hu, “Robust Occlusion Handling in Object Tracking”, IEEE Conference of Computer Vision and Pattern Recognition, 2007, pp.1-8.

Related Work [1]: – A novel bidirectional learning framework for discrimination between the object and background is presented. – The bidirectional learning rule is reasonable but the nonparametric kernel density based estimation for discrimination is not adaptive and not stable during the tracking. 5

Cont. [2]: – The occlusion situation is analyzed by exploiting the spatiotemporal context information. – And they rectify the occlusion-interfered erroneous target location by employing a variant- mask template matching operation. – For rigid object, the correct location can be obtained by their method, but for human tracking, spatiotemporal context information may not work well. 6

Outline Of Proposed Approach The main idea is that occlusion detection and handling strategy are added before model update stage. We use the particle filter algorithm to first estimate the positions of the targets We introduce the classical tracking algorithm KLT (Kanade-Lucas-Tomasi) [3] to do the occlusion detection. 7 [3] C. Tomasi and T. Kanade. “Detection and Tracking of Point Features ”, Carnegie Mellon University Technical Report CMU-CS , 1991.

Particle Filter 8 Monte Carlo. Bayesian recursion is a probability model of estimation. x : state z : observation value k : time

Cont. Particle filter use Monte Carlo to deal with Bayesian recursion. 9

Cont. 10

The Proposed Approach For Occlusion Detection Most works utilize the similarity of color histogram, size of targets or distance between targets when dealing with the occlusion detection. Occlusion detection is divided into two parts, occlusion detection and drift detection. 11

Occlusion Detection Distance between color histogram of target model and candidate. Number of tracked feature points. Motion directions of those tracked points. 12

Color Factor The distance between the model histogram r Μ and the candidate histogram r is defined as ρ is the Bhattacharyya coefficient. And the occlusion detection rule of color part is defined as 13 ρ max is max value among all the candidates in particle filter.

Feature Factor KLT feature is presented here. It performs by selecting the key feature points in the first frame and finding the corresponding points in next frame. If the occlusion happens, most points in tracking window will be lost. 14 N thr is set to 3, and 25 feature points are selected in the model blob. If tracked N is higher than 20, this frame’s tracking results seems to be good.

Motion Factor Estimated tracking window is compared with last frame by KLT to get the motion vectors of feature points Use K-means algorithm to cluster these vectors into two groups according to direction. 15 N g1 and N g2 are the number of the vectors in two groups.

Drift Detection If the velocity of feature points is a little large, it means that significant drift may be happened. The average vertical velocity and average horizontal velocity can be calculated according to the KLT feature tracker. 16 Δv x and Δv y are the average horizontal velocity and the average vertical velocity among tracked points.

17

The Proposed Approach For Occlusion Handling Occlusion handling strategy – If an occlusion happens, the updating of the target model must be stopped. – Average of values in a bigger group is used to represent the speed of target in current frame. – Use the average value of nearly 10 frames’ un- occluded target speed to represent the estimated speed of occluded target. – For the moving object detection, we do the subtraction between two adjacent frames. 18

Cont. Drift handling strategy – In order to remedy the drift problem, we should utilize the vertical and horizontal velocity of the feature points to change the position of estimated tracking window. 19

Experimental Result Standard datasets : – The resolution of videos in CAVIAR dataset is 384×288 and in PETS2009 is 768×576. The proposed algorithm was implemented in C++, and we used a 2.93GHz CPU and 4GB RAM. 20

21

22

23 [6] W. Qu, D. Schonfeld, and M. Mohamed, “Real-Time Interactively Distributed Multi-Object Tracking Using a Magnetic-Inertia Potential Model’’, IEEE International Conference on Computer Vision, 2005, vol.1, pp [7] M. Yang, T. Yu, and Y. Wu, ‘‘Game-Theoretic Multiple Target Tracking’’, IEEE International Conference on Computer Vision, 2007, pp.1-8.

Conclusion In this paper, we proposed a KLT based occlusion handling strategy in a particle filter track frame. Instead of using KLT as a tracker, we used it in occlusion detection to help tracking. Our result showed that our method is really effective. 24