Video Segmentation Based on Image Change Detection for Surveillance Systems Tung-Chien Chen EE 264: Image Processing and Reconstruction.

Slides:



Advertisements
Similar presentations
People Counting and Human Detection in a Challenging Situation Ya-Li Hou and Grantham K. H. Pang IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS—PART.
Advertisements

Change Detection C. Stauffer and W.E.L. Grimson, “Learning patterns of activity using real time tracking,” IEEE Trans. On PAMI, 22(8): , Aug 2000.
Foreground Background detection from video Foreground Background detection from video מאת : אבישג אנגרמן.
MPEG-4 Objective Standardize algorithms for audiovisual coding in multimedia applications allowing for Interactivity High compression Scalability of audio.
Adviser : Ming-Yuan Shieh Student ID : M Student : Chung-Chieh Lien VIDEO OBJECT SEGMENTATION AND ITS SALIENT MOTION DETECTION USING ADAPTIVE BACKGROUND.
The image based surveillance system for personnel and vehicle tracking Chairman:Hung-Chi Yang Advisor: Yen-Ting Chen Presenter: Fong-Ren Sie Date:
Computer and Robot Vision I
Haojie Li Jinhui Tang Si Wu Yongdong Zhang Shouxun Lin Automatic Detection and Analysis of Player Action in Moving Background Sports Video Sequences IEEE.
Video Coding with Spatio-temporal Texture Synthesis and Edge-based inpainting Chunbo Zhu, Xiaoyan Sun, Feng Wu, and Houqiang Li ICME 2008.
Modeling Pixel Process with Scale Invariant Local Patterns for Background Subtraction in Complex Scenes (CVPR’10) Shengcai Liao, Guoying Zhao, Vili Kellokumpu,
Motion Detection And Analysis Michael Knowles Tuesday 13 th January 2004.
Efficient Moving Object Segmentation Algorithm Using Background Registration Technique Shao-Yi Chien, Shyh-Yih Ma, and Liang-Gee Chen, Fellow, IEEE Hsin-Hua.
1 Static Sprite Generation Prof ︰ David, Lin Student ︰ Jang-Ta, Jiang
Robust Object Segmentation Using Adaptive Thresholding Xiaxi Huang and Nikolaos V. Boulgouris International Conference on Image Processing 2007.
Region-Level Motion- Based Background Modeling and Subtraction Using MRFs Shih-Shinh Huang Li-Chen Fu Pei-Yung Hsiao 2007 IEEE.
Object Detection and Tracking Mike Knowles 11 th January 2005
1 Integration of Background Modeling and Object Tracking Yu-Ting Chen, Chu-Song Chen, Yi-Ping Hung IEEE ICME, 2006.
Effective Gaussian mixture learning for video background subtraction Dar-Shyang Lee, Member, IEEE.
IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 20, NO. 11, NOVEMBER 2011 Qian Zhang, King Ngi Ngan Department of Electronic Engineering, the Chinese university.
Instructor : Dr. K. R. Rao Presented by: Rajesh Radhakrishnan.
A REAL-TIME VIDEO OBJECT SEGMENTATION ALGORITHM BASED ON CHANGE DETECTION AND BACKGROUND UPDATING 楊靜杰 95/5/18.
Shadow Detection In Video Submitted by: Hisham Abu saleh.
Object Tracking for Retrieval Application in MPEG-2 Lorenzo Favalli, Alessandro Mecocci, Fulvio Moschetti IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR.
1 Real Time, Online Detection of Abandoned Objects in Public Areas Proceedings of the 2006 IEEE International Conference on Robotics and Automation Authors.
Jacinto C. Nascimento, Member, IEEE, and Jorge S. Marques
Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04.
1 Activity and Motion Detection in Videos Longin Jan Latecki and Roland Miezianko, Temple University Dragoljub Pokrajac, Delaware State University Dover,
1 REAL-TIME IMAGE PROCESSING APPROACH TO MEASURE TRAFFIC QUEUE PARAMETERS. M. Fathy and M.Y. Siyal Conference 1995: Image Processing And Its Applications.
Video Motion Interpolation for Special Effect Applications Timothy K. Shih, Senior Member, IEEE, Nick C. Tang, Joseph C. Tsai, and Jenq-Neng Hwang, Fellow,
Olga Zoidi, Anastasios Tefas, Member, IEEE Ioannis Pitas, Fellow, IEEE
1 Efficient Reference Frame Selector for H.264 Tien-Ying Kuo, Hsin-Ju Lu IEEE CSVT 2008.
1 Mean shift and feature selection ECE 738 course project Zhaozheng Yin Spring 2005 Note: Figures and ideas are copyrighted by original authors.
1. Introduction Motion Segmentation The Affine Motion Model Contour Extraction & Shape Estimation Recursive Shape Estimation & Motion Estimation Occlusion.
Reducing/Eliminating visual artifacts in HEVC by Deblocking filter By: Harshal Shah Under the guidance of: Dr. K. R. Rao.
1 Lucia Maddalena and Alfredo Petrosino, Senior Member, IEEE A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications.
ECE 8433: Statistical Signal Processing Detection of Uncovered Background and Moving Pixels Detection of Uncovered Background & Moving Pixels Presented.
Sadaf Ahamed G/4G Cellular Telephony Figure 1.Typical situation on 3G/4G cellular telephony [8]
1 Webcam Mouse Using Face and Eye Tracking in Various Illumination Environments Yuan-Pin Lin et al. Proceedings of the 2005 IEEE Y.S. Lee.
Low-Power H.264 Video Compression Architecture for Mobile Communication Student: Tai-Jung Huang Advisor: Jar-Ferr Yang Teacher: Jenn-Jier Lien.
Detection of nerves in Ultrasound Images using edge detection techniques NIRANJAN TALLAPALLY.
Video Segmentation Prepared By M. Alburbar Supervised By: Mr. Nael Abu Ras University of Palestine Interactive Multimedia Application Development.
Bo QIN, Zongshun MA, Zhenghua FANG, Shengke WANG Computer-Aided Design and Computer Graphics, th IEEE International Conference on, p Presenter.
Hierarchical Method for Foreground DetectionUsing Codebook Model Jing-Ming Guo, Yun-Fu Liu, Chih-Hsien Hsia, Min-Hsiung Shih, and Chih-Sheng Hsu IEEE TRANSACTIONS.
Advances in digital image compression techniques Guojun Lu, Computer Communications, Vol. 16, No. 4, Apr, 1993, pp
Expectation-Maximization (EM) Case Studies
Figure ground segregation in video via averaging and color distribution Introduction to Computational and Biological Vision 2013 Dror Zenati.
Fast and Robust Algorithm of Tracking Multiple Moving Objects for Intelligent Video Surveillance Systems Jong Sun Kim, Dong Hae Yeom, and Young Hoon Joo,2011.
Implementation, Comparison and Literature Review of Spatio-temporal and Compressed domains Object detection. By Gokul Krishna Srinivasan Submitted to Dr.
An Effective Three-step Search Algorithm for Motion Estimation
Robust Nighttime Vehicle Detection by Tracking and Grouping Headlights Qi Zou, Haibin Ling, Siwei Luo, Yaping Huang, and Mei Tian.
Journal of Visual Communication and Image Representation
Target Tracking In a Scene By Saurabh Mahajan Supervisor Dr. R. Srivastava B.E. Project.
Detection of nerves in Ultrasound Images using edge detection techniques NIRANJAN TALLAPALLY.
Particle Filtering for Symmetry Detection and Segmentation Pramod Vemulapalli.
Adaptive background mixture models for real-time tracking 信息行业化工程中心 赵红.
Shen-Chuan Tai, Chien-Shiang Hong, Cheng-An Fu National Cheng Kung University, Tainan City,Taiwan (R.O.C.),DCMC Lab Pacific-Rim Symposium on Image and.
A Fast Video Noise Reduction Method by Using Object-Based Temporal Filtering Thou-Ho (Chao-Ho) Chen, Zhi-Hong Lin, Chin-Hsing Chen and Cheng-Liang Kao.
Portable Camera-Based Assistive Text and Product Label Reading From Hand-Held Objects for Blind Persons.
Detection, Tracking and Recognition in Video Sequences Supervised By: Dr. Ofer Hadar Mr. Uri Perets Project By: Sonia KanOra Gendler Ben-Gurion University.
Motion tracking TEAM D, Project 11: Laura Gui - Timisoara Calin Garboni - Timisoara Peter Horvath - Szeged Peter Kovacs - Debrecen.
Motion Estimation of Moving Foreground Objects Pierre Ponce ee392j Winter March 10, 2004.
SZTAKI DEVA in Remote Sensing, Pattern recognition and change detection In Remote sensing Distributed Events Analysis Research Group Computer.
Ehsan Nateghinia Hadi Moradi (University of Tehran, Tehran, Iran) Video-Based Multiple Vehicle Tracking at Intersections.
Video object segmentation and its salient motion detection using adaptive background generation Kim, T.K.; Im, J.H.; Paik, J.K.;  Electronics Letters 
Motion Detection And Analysis
A New Approach to Track Multiple Vehicles With the Combination of Robust Detection and Two Classifiers Weidong Min , Mengdan Fan, Xiaoguang Guo, and Qing.
Object tracking in video scenes Object tracking in video scenes
Implementation on video object segmentation algorithm
A Block Based MAP Segmentation for Image Compression
Change Detection and Visualization
Presentation transcript:

Video Segmentation Based on Image Change Detection for Surveillance Systems Tung-Chien Chen EE 264: Image Processing and Reconstruction

Outline Background –Image Change Detection –Video Surveillance Systems Implementation –Block diagram and algorithm description Demo Comment

Image Change Detection Differencing Significance and hypothesis tests Predictive models Shading Models Background Models Change mask consistency and post processing ….. Video surveillance Remote sensing Medical diagnosis and treatment, Civil infrastructure, Underwater sensing, Driver assistance systems ……

In My Project Differencing Significance and hypothesis tests Predictive models Shading Models Background Models Change mask consistency and post processing ….. Video surveillance Remote sensing Medical diagnosis and treatment, Civil infrastructure, Underwater sensing, Driver assistance systems ……

Video Surveillance Systems A technological tool that assists humans by providing an extended perception and reasoning capability about situations of interest that occur in the monitored environments

Video Surveillance Systems A technological tool that assists humans by providing an extended perception and reasoning capability about situations of interest that occur in the monitored environments

Reference Paper Efficient moving object Segmentation Algorithm Using Background Registration Technique S-Y Chien, S-Y Ma, and L-G Chen, IEEE National Taiwan University IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2002

Block Diagram of the Framework

Step1 – Differencing (1/2) Frame difference and thresholding –Difference between current frame and previous frame FD: frame difference FDM: frame difference mask

Step1 – Differencing (2/2) Background differencing and thresholding –Difference between current frame and background BD: background difference BDM: background difference mask

Step2 – Background Registration According to FDM, pixels not moving for a long time are considered as reliable background pixels SI: Stationary index BI: Background indicator BG: Background information

Example of Background Registration (1/2)

Example of Background Registration (2/2) Include the function of background updating

Step2- Object Detection and Initial Object Mask Generation Object detection –Produce “Initial object mask” (IOM)

Object Detection Look up table for object detection

Step4- Post-processing Two main parts in post-processing: –Noise region elimination and boundary smoothing Connected component algorithm to eliminate small regions Morphological close–open operations are applied to smooth the object boundary

Example of Post Operation Initial Object MaskAfter Connect Component After Close-open OperationFinal Object

Results and Demo

Result Demo

Comments (1/2) For change detection based segmentation algorithm for surveillance system –Speed is high, but not robust –Performance degrade with the uncovered background situation, still object situation, light changing, shadow, and noise –Post-process can promote, but lose efficiency –Should automatically decide the thresholds –Some limitations: strong change in light source, difference luminance between background foreground, camera moving/zoom/rotation, foreground object should move

Reference [1] R. J. Radke, S. Andra, O. Al-Kofahi, and B. Roysam “Image Change Detection Algorithms: A Systematic Survey,” IEEE Trans. Image Processing, vol. 14, no. 3, pp. 294–303, March [2] R. Collins, A. Lipton, and T. Kanade, “Introduction to the special section on video surveillance,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 745–746, Aug [3] C. Stauffer and W. E. L. Grimson, “Learning patterns of activity using real-time tracking,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 747–757, Aug [4] C. R. Wren, A. Azarbayejani, T. Darrell, and A. Pentland, “Pfinder: Real-time tracking of the human body,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 780–785, Jul [5] R. Mech and M. Wollborn, “A noise robust method for 2D shape estimation of moving objects in video sequences considering a moving camera,” Signal Process., vol. 66, [6] S.-Y.Ma, S.-Y. Chien, and L.-G. Chen, “An efficient moving object segmentation algorithm for MPEG-4 encoding systems,” in Proc. Int. Symp. Intelligent Signal Processing and Communication Systems 2000, [7] S. Y. Chien, S. Y. Ma, and L. G. Chen “Efficient Moving Object Segmentation Algorithm Using Background Registration Technique,” IEEE Trans. on circuits and system for video technology, vol. 12, no. 7, pp. 577–586, JULY [8] R. M. Haralick and L. G. Shapiro, Computer and Robot Vision. Reading, MA: Addison- Wesley, [9] J. Serra, Image Analysis and Mathematical Morphology. London, U.K.: Academic, 1982.

Thanks for listening !! Questions ?