Andrea Colombari and Andrea Fusiello, Member, IEEE.

Slides:



Advertisements
Similar presentations
A Robust Super Resolution Method for Images of 3D Scenes Pablo L. Sala Department of Computer Science University of Toronto.
Advertisements

Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
11/11/02 IDR Workshop Dealing With Location Uncertainty in Images Hasan F. Ates Princeton University 11/11/02.
Change Detection C. Stauffer and W.E.L. Grimson, “Learning patterns of activity using real time tracking,” IEEE Trans. On PAMI, 22(8): , Aug 2000.
Patch to the Future: Unsupervised Visual Prediction
1 Video Processing Lecture on the image part (8+9) Automatic Perception Volker Krüger Aalborg Media Lab Aalborg University Copenhagen
M.S. Student, Hee-Jong Hong
Robust Foreground Detection in Video Using Pixel Layers Kedar A. Patwardhan, Guillermoo Sapire, and Vassilios Morellas IEEE TRANSACTION ON PATTERN ANAYLSIS.
Foreground Modeling The Shape of Things that Came Nathan Jacobs Advisor: Robert Pless Computer Science Washington University in St. Louis.
Robust Object Tracking via Sparsity-based Collaborative Model
Adviser : Ming-Yuan Shieh Student ID : M Student : Chung-Chieh Lien VIDEO OBJECT SEGMENTATION AND ITS SALIENT MOTION DETECTION USING ADAPTIVE BACKGROUND.
Human-Computer Interaction Human-Computer Interaction Segmentation Hanyang University Jong-Il Park.
Multi-View Learning in the Presence of View Disagreement C. Mario Christoudias, Raquel Urtasun, Trevor Darrell UC Berkeley EECS & ICSI MIT CSAIL.
Bayesian Robust Principal Component Analysis Presenter: Raghu Ranganathan ECE / CMR Tennessee Technological University January 21, 2011 Reading Group (Xinghao.
A LOW-COMPLEXITY, MOTION-ROBUST, SPATIO-TEMPORALLY ADAPTIVE VIDEO DE-NOISER WITH IN-LOOP NOISE ESTIMATION Chirag Jain, Sriram Sethuraman Ittiam Systems.
Tracking Features with Large Motion. Abstract Problem: When frame-to-frame motion is too large, KLT feature tracker does not work. Solution: Estimate.
Wavelet-Domain Video Denoising Based on Reliability Measures Vladimir Zlokolica, Aleksandra Piˇzurica and Wilfried Philips Circuits and Systems for Video.
IEEE TCSVT 2011 Wonjun Kim Chanho Jung Changick Kim
Modeling Pixel Process with Scale Invariant Local Patterns for Background Subtraction in Complex Scenes (CVPR’10) Shengcai Liao, Guoying Zhao, Vili Kellokumpu,
Boundary matting for view synthesis Samuel W. Hasinoff Sing Bing Kang Richard Szeliski Computer Vision and Image Understanding 103 (2006) 22–32.
Robust Object Segmentation Using Adaptive Thresholding Xiaxi Huang and Nikolaos V. Boulgouris International Conference on Image Processing 2007.
Chapter Topics The Completely Randomized Model: One-Factor Analysis of Variance F-Test for Difference in c Means The Tukey-Kramer Procedure ANOVA Assumptions.
Multi-view stereo Many slides adapted from S. Seitz.
Lecture 9 Hidden Markov Models BioE 480 Sept 21, 2004.
Effective Gaussian mixture learning for video background subtraction Dar-Shyang Lee, Member, IEEE.
Tracking Video Objects in Cluttered Background
Multi-camera Video Surveillance: Detection, Occlusion Handling, Tracking and Event Recognition Oytun Akman.
Dorin Comaniciu Visvanathan Ramesh (Imaging & Visualization Dept., Siemens Corp. Res. Inc.) Peter Meer (Rutgers University) Real-Time Tracking of Non-Rigid.
EE392J Final Project, March 20, Multiple Camera Object Tracking Helmy Eltoukhy and Khaled Salama.
Tracking Pedestrians Using Local Spatio- Temporal Motion Patterns in Extremely Crowded Scenes Louis Kratz and Ko Nishino IEEE TRANSACTIONS ON PATTERN ANALYSIS.
Mean-shift and its application for object tracking
BraMBLe: The Bayesian Multiple-BLob Tracker By Michael Isard and John MacCormick Presented by Kristin Branson CSE 252C, Fall 2003.
Characterizing activity in video shots based on salient points Nicolas Moënne-Loccoz Viper group Computer vision & multimedia laboratory University of.
Video Mosaics AllisonW. Klein Tyler Grant Adam Finkelstein Michael F. Cohen.
Chih-Ming Chen, Student Member, IEEE, Ying-ping Chen, Member, IEEE, Tzu-Ching Shen, and John K. Zao, Senior Member, IEEE Evolutionary Computation (CEC),
#MOTION ESTIMATION AND OCCLUSION DETECTION #BLURRED VIDEO WITH LAYERS
Video Segmentation Prepared By M. Alburbar Supervised By: Mr. Nael Abu Ras University of Palestine Interactive Multimedia Application Development.
1 University of Texas at Austin Machine Learning Group 图像与视频处理 计算机学院 Motion Detection and Estimation.
MACHINE LEARNING 8. Clustering. Motivation Based on E ALPAYDIN 2004 Introduction to Machine Learning © The MIT Press (V1.1) 2  Classification problem:
Vehicle Segmentation and Tracking From a Low-Angle Off-Axis Camera Neeraj K. Kanhere Committee members Dr. Stanley Birchfield Dr. Robert Schalkoff Dr.
ANOVA Assumptions 1.Normality (sampling distribution of the mean) 2.Homogeneity of Variance 3.Independence of Observations - reason for random assignment.
CS654: Digital Image Analysis
Scene Completion Using Millions of Photographs James Hays, Alexei A. Efros Carnegie Mellon University ACM SIGGRAPH 2007.
Expectation-Maximization (EM) Case Studies
Figure ground segregation in video via averaging and color distribution Introduction to Computational and Biological Vision 2013 Dror Zenati.
by Mitchell D. Swanson, Bin Zhu, and Ahmed H. Tewfik
CVPR2013 Poster Detecting and Naming Actors in Movies using Generative Appearance Models.
1 Introduction What does it mean when there is a strong positive correlation between x and y ? Regression analysis aims to find a precise formula to relate.
Optical Flow. Distribution of apparent velocities of movement of brightness pattern in an image.
Segmentation of Vehicles in Traffic Video Tun-Yu Chiang Wilson Lau.
Data Hiding in Image and Video: Part II—Designs and Applications Min Wu, Heather Yu, and Bede Liu.
 Present by 陳群元.  Introduction  Previous work  Predicting motion patterns  Spatio-temporal transition distribution  Discerning pedestrians  Experimental.
Course14 Dynamic Vision. Biological vision can cope with changing world Moving and changing objects Change illumination Change View-point.
Improved Census Transforms for Resource-Optimized Stereo Vision
Other Clustering Techniques
Journal of Visual Communication and Image Representation
Presented by: Idan Aharoni
1/39 Motion Adaptive Search for Fast Motion Estimation 授課老師:王立洋老師 製作學生: M 蔡鐘葳.
Learning and Removing Cast Shadows through a Multidistribution Approach Nicolas Martel-Brisson, Andre Zaccarin IEEE TRANSACTIONS ON PATTERN ANALYSIS AND.
RECONSTRUCTION OF MULTI- SPECTRAL IMAGES USING MAP Gaurav.
Motion Estimation of Moving Foreground Objects Pierre Ponce ee392j Winter March 10, 2004.
Video object segmentation and its salient motion detection using adaptive background generation Kim, T.K.; Im, J.H.; Paik, J.K.;  Electronics Letters 
Real-Time Soft Shadows with Adaptive Light Source Sampling
Dynamical Statistical Shape Priors for Level Set Based Tracking
Image Processing for Physical Data
Image Segmentation Techniques
Presented by: Yang Yu Spatiotemporal GMM for Background Subtraction with Superpixel Hierarchy Mingliang Chen, Xing Wei, Qingxiong.
Image and Video Processing
EM Algorithm and its Applications
Li Li, Zhu Li, Vladyslav Zakharchenko, Jianle Chen, Houqiang Li
Presentation transcript:

Andrea Colombari and Andrea Fusiello, Member, IEEE

 INTRODUCTION  METHOD  EXPERIMENTAL RESULTS  CONCLUSION

 INTRODUCTION  METHOD  EXPERIMENTAL RESULTS  CONCLUSION

 there has been a large amount of work addressing the issues of background model representation and maintenance but not as much focusing on model initialization  The main reason is that often the assumption is made that initialization can be achieved by exploiting some clean frames at the beginning of the sequence  Obviously this assumption is hardly met in real scenarios,because of continuous clutter presence

 INTRODUCTION  METHOD  EXPERIMENTAL RESULTS  CONCLUSION

background initialization is based on the following hypothesis: i) the background is constant ii) in each spatio-temporal patch (of a given footprint size) the background is revealed at least once iii) foreground objects introduce a color discontinuity with the background

 We model the video sequence as a 3-D array of pixel values.  A spatio-temporal patch Vs is a sub-array of the video sequence  The window is the spatial footprint of the patch  An image patch is a spatio-temporal patch with a singleton temporal index:

Estimating Camera Noise Assuming that noise is i.i.d. Gaussian with zero-mean,, differences of pixel values along the time-line A robust estimator of the spread of a distribution is given by the median absolute difference (MAD)

Temporal Clustering The spatial indices are subdivided into windows Wi of size, overlapping by half of their size in both dimensions Clustering image patches that depict the same static portion of the scene with single linkage agglomerative clustering

be a spatio-temporal patch with footprint which extends in time from the first to the last frame sum of squared distances(SSD) If, they can be linked in the clustering

Compute cluster representative by averaging with

Background Tessellation The algorithm assigns the background patch to W by choosing one from the cluster representatives with footprint W The selected patch has to fulfill two requirements: 1) Seamlessness 2) Best continuation

1) Seamlessness 2) Best continuation

Summary of the Algorithm 1) Estimate the camera noise as the sample variance of frames difference, using the MAD 2) Subdivide the spatial domain into overlapping windows W or footprints. 3) On each footprint, cluster image patches with single linkage agglomerative clustering,then using SSD

Summary of the Algorithm 4) Compute cluster representative 5) Select the clusters of maximal length, insert their representatives in the background B 6) Select a footprint W which is only partially filled in B

Summary of the Algorithm 7) For each cluster representative evaluate the discrepancy with B, and select candidates patches for insertion in B 8) The candidate patches enter a round robin tournament, where the comparison between any two of them is done. The winner of the tournament in inserted in B 9) Repeat from Step 6 until the background image is complete.

 INTRODUCTION  METHOD  EXPERIMENTAL RESULTS  CONCLUSION

 INTRODUCTION  METHOD  EXPERIMENTAL RESULTS  CONCLUSION

 The method is robust, as it can cope with serious occlusions caused by moving objects  It is scalable, as it can deal with any number of frames greater or equal than two  It is effective, as it always recovers the background when the assumptions are satisfied

Thank you