ICBV Course Final Project Arik Krol Aviad Pinkovezky.

Slides:



Advertisements
Similar presentations
Xiaoyong Ye Franz Alexander Van Horenbeke David Abbott
Advertisements

SE263 Video Analytics Course Project Initial Report Presented by M. Aravind Krishnan, SERC, IISc X. Mei and H. Ling, ICCV’09.
Change Detection C. Stauffer and W.E.L. Grimson, “Learning patterns of activity using real time tracking,” IEEE Trans. On PAMI, 22(8): , Aug 2000.
Joshua Fabian Tyler Young James C. Peyton Jones Garrett M. Clayton Integrating the Microsoft Kinect With Simulink: Real-Time Object Tracking Example (
Hand Gesture for Taking Self Portrait Shaowei Chu and Jiro Tanaka University of Tsukuba Japan 12th July 15 minutes talk.
VisHap: Guangqi Ye, Jason J. Corso, Gregory D. Hager, Allison M. Okamura Presented By: Adelle C. Knight Augmented Reality Combining Haptics and Vision.
Xin Zhang, Zhichao Ye, Lianwen Jin, Ziyong Feng, and Shaojie Xu
1 Video Processing Lecture on the image part (8+9) Automatic Perception Volker Krüger Aalborg Media Lab Aalborg University Copenhagen
F ACE TRACKING EE 7700 Name: Jing Chen Shaoming Chen.
Image-Based Target Detection and Tracking Aggelos K. Katsaggelos Thrasyvoulos N. Pappas Peshala V. Pahalawatta C. Andrew Segall SensIT, Santa Fe January.
AlgirdasBeinaravičius Gediminas Mazrimas Salman Mosslem.
Color Image Processing
Autonomous Vehicle Pursuit of Target Through Optical Recognition Vision & Image Science Laboratory, Department of Electrical Engineering,Technion Daniel.
SurroundSense: Mobile Phone Localization via Ambience Fingerprinting Written by Martin Azizyan, Ionut Constandache, & Romit Choudhury Presented by Craig.
Virtual Dart: An Augmented Reality Game on Mobile Device Supervisor: Professor Michael R. Lyu Prepared by: Lai Chung Sum Siu Ho Tung.
EE 7730 Image Segmentation.
Video Object Tracking and Replacement for Post TV Production LYU0303 Final Year Project Spring 2004.
Segmentation Divide the image into segments. Each segment:
Head Tracking and Virtual Reality by Benjamin Nielsen.
Real-time Hand Pose Recognition Using Low- Resolution Depth Images
Cindy Song Sharena Paripatyadar. Use vision for HCI Determine steps necessary to incorporate vision in HCI applications Examine concerns & implications.
CSE 291 Final Project: Adaptive Multi-Spectral Differencing Andrew Cosand UCSD CVRR.
Stockman MSU Fall Computing Motion from Images Chapter 9 of S&S plus otherwork.
Motion Estimation Today’s Readings Trucco & Verri, 8.3 – 8.4 (skip 8.3.3, read only top half of p. 199) Numerical Recipes (Newton-Raphson), 9.4 (first.
Hand Movement Recognition By: Tokman Niv Levenbroun Guy Instructor: Todtfeld Ari.
Multi-camera Video Surveillance: Detection, Occlusion Handling, Tracking and Event Recognition Oytun Akman.
Triangle-based approach to the detection of human face March 2001 PATTERN RECOGNITION Speaker Jing. AIP Lab.
A Real-Time for Classification of Moving Objects
[cvPONG] A 3-D Pong Game Controlled Using Computer Vision Techniques Quan Yu and Chris Wagner.
Jacinto C. Nascimento, Member, IEEE, and Jorge S. Marques
Behavior Analysis Midterm Report Lipov Irina Ravid Dan Kotek Tommer.
AKSHAY UTTAMANI( ) DIVYAM JAISWAL( ) SAURABH KHANDELWAL( )
Conference Room Laser Pointer System Preliminary Design Report Anna Goncharova Brent Hoover Alex Mendes.
1 Activity and Motion Detection in Videos Longin Jan Latecki and Roland Miezianko, Temple University Dragoljub Pokrajac, Delaware State University Dover,
Tal Mor  Create an automatic system that given an image of a room and a color, will color the room walls  Maintaining the original texture.
Feature and object tracking algorithms for video tracking Student: Oren Shevach Instructor: Arie nakhmani.
Multimedia Specification Design and Production 2013 / Semester 2 / week 8 Lecturer: Dr. Nikos Gazepidis
A Method for Hand Gesture Recognition Jaya Shukla Department of Computer Science Shiv Nadar University Gautam Budh Nagar, India Ashutosh Dwivedi.
Application in Computer Vision Final Project Nir Slakman, Oren Zur and Noam Ben-Ari.
1 Webcam Mouse Using Face and Eye Tracking in Various Illumination Environments Yuan-Pin Lin et al. Proceedings of the 2005 IEEE Y.S. Lee.
Algirdas Beinaravičius Gediminas Mazrimas Salman Mosslem.
Interactive Sand Art Drawing Using RGB-D Sensor
3d Pose Detection Used by Kinect
Kylie Gorman WEEK 1-2 REVIEW. CONVERTING AN IMAGE FROM RGB TO HSV AND DISPLAY CHANNELS.
1 Motion Analysis using Optical flow CIS601 Longin Jan Latecki Fall 2003 CIS Dept of Temple University.
Team IRALAR Breanna Heidenburg -- Michael Lenisa -- Daniel Wentzel Advisor: Dr. Malinowski.
Counting How Many Words You Read
Video Surveillance Under The Guidance of Smt. D.Neelima M.Tech., Asst. Professor Submitted by G. Subrahmanyam Roll No: 10021F0013 M.C.A.
Belief Networks in Computer Vision Applications Alex Yakushev CMPS 290C final project Winter 2006.
Presented by: Idan Aharoni
Intelligent Robotics Today: Vision & Time & Space Complexity.
EE368: Digital Image Processing Bernd Girod Leahy, p.1/15 Face Detection on Similar Color Images Scott Leahy EE368, Stanford University May 30, 2003.
Detecting Occlusion from Color Information to Improve Visual Tracking
Detection, Tracking and Recognition in Video Sequences Supervised By: Dr. Ofer Hadar Mr. Uri Perets Project By: Sonia KanOra Gendler Ben-Gurion University.
Over the recent years, computer vision has started to play a significant role in the Human Computer Interaction (HCI). With efficient object tracking.
EE368 Face Detection Project Angi Chau, Ezinne Oji, Jeff Walters 28 May, 2003.
Color Image Processing
Color Image Processing
Human Detection in Surveillance Applications
Color Image Processing
Tremor Detection Using Motion Filtering and SVM Bilge Soran, Jenq-Neng Hwang, Linda Shapiro, ICPR, /16/2018.
Color Image Processing
Higher School of Economics , Moscow, 2016
Presented by :- Vishal Vijayshankar Mishra
Week 6 Nicholas Baker.
Estimation of Skin Color Range Using Achromatic Features
Color Image Processing
Higher School of Economics , Moscow, 2016
Learning complex visual concepts
Sign Language Recognition With Unsupervised Feature Learning
Presentation transcript:

ICBV Course Final Project Arik Krol Aviad Pinkovezky

Motivation: Current MMI is based mainly on “Point & Click” devices Video Capturing as a new Approach for MMI Hardware is available - Web Cameras and powerful processors Potential Usages – Working with laptops, users with “hands on keyboards”, etc

Goals: Exploring the field of motion detection Exploring the field of skin colors distinction A working Demo that can detect palm movements: No Real Time, yet… Minimal rate of False detections Determine Direction of movement

Motion Detection: First approach: Segmentation by Clustering (K-Means) Motion Detection by tracking the centers of gravity of clusters over the frames The Problem – Complexity of Calculation, doesn’t fit into real time scenario!

Motion Detection (cont.): Second approach: Subtracting consecutive frames Motion Detection by tracking the difference in pixels values Note - Assumptions are: Relatively static background and stationary camera

Motion Detection implementation: For each two consecutive frames: Convert from RGB to Grayscale Subtraction Gaussian Smoothing

Skin Color Detection: H.S.V – Hue, Saturation, Value An alternative representation of color pixels Enables us to isolate Hue levels, regardless of Saturation and Value levels

Skin Color Detection (cont.): The human skin is characterized by different levels of red hue to 25 degrees Value level is greater than 40

Skin Motion Detection: { Motion Pixels } { Skin Pixels} = {Skin Motion Pixels} Direction of movement – Determined by the differences of X axis value averages between consecutive frames Setting adequate thresholds – by trial and error

Skin Motion Detection: Now, let’s try to detect a moving piece of paper: Skin Motion detection results finally in no detection at all.

Problems we encountered: Face – Can create false detection of skin movement (head movements & non skin movement) – Solved by tracking the 1/3 bottom part of the image. Complexity of calculation – better than clustering, yet not real time like – unsolved Skin like objects – may cause false detection

A Few Results:

Future Improvements: Improving run time performances to support real time motion detection, can be achieved by: Using different programming languages Using hardware acceleration (parallel computing, GPGPU, etc.) Setting thresholds dynamically by calibrating the system. Identifying a larger variety of movements, and adding new features accordingly

References: Francesca Gasparini, Raimondo Schettini, Skin segmentation using multiple thresholdings University of Sussex, UK. Web page of David Young, “Static Camera and moving objects”: And of course, Wikipedia – H.S.V