Cynthia Atherton.  Methodology  Code  Results  Problems  Plans.

Slides:



Advertisements
Similar presentations
Chamfer Distance for Handshape Detection and Recognition CSE 6367 – Computer Vision Vassilis Athitsos University of Texas at Arlington.
Advertisements

Detection, Segmentation, and Pose Recognition of Hands in Images by Christopher Schwarz Thesis Chair: Dr. Niels da Vitoria Lobo.
VisHap: Guangqi Ye, Jason J. Corso, Gregory D. Hager, Allison M. Okamura Presented By: Adelle C. Knight Augmented Reality Combining Haptics and Vision.
Grape Detection in Vineyards Ishay Levi Eran Brill.
Segmentation of Floor in Corridor Images for Mobile Robot Navigation Yinxiao Li Clemson University Committee Members: Dr. Stanley Birchfield (Chair) Dr.
Database-Based Hand Pose Estimation CSE 6367 – Computer Vision Vassilis Athitsos University of Texas at Arlington.
Forward-Backward Correlation for Template-Based Tracking Xiao Wang ECE Dept. Clemson University.
Automatic in vivo Microscopy Video Mining for Leukocytes * Chengcui Zhang, Wei-Bang Chen, Lin Yang, Xin Chen, John K. Johnstone.
Tracking Multiple Occluding People by Localizing on Multiple Scene Planes Saad M. Khan and Mubarak Shah, PAMI, VOL. 31, NO. 3, MARCH 2009, Donguk Seo
Segmentation (2): edge detection
3D Skeletons Using Graphics Hardware Jonathan Bilodeau Chris Niski.
1Ellen L. Walker Edges Humans easily understand “line drawings” as pictures.
Virtual Dart: An Augmented Reality Game on Mobile Device Supervisor: Professor Michael R. Lyu Prepared by: Lai Chung Sum Siu Ho Tung.
A new face detection method based on shape information Pattern Recognition Letters, 21 (2000) Speaker: M.Q. Jing.
1 Model Fitting Hao Jiang Computer Science Department Oct 6, 2009.
EE663 Image Processing Edge Detection 2 Dr. Samir H. Abdul-Jauwad Electrical Engineering Department King Fahd University of Petroleum & Minerals.
Ensemble Tracking Shai Avidan IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE February 2007.
CS223B Assignment 1 Recap. Lots of Solutions! 37 Groups Many different approaches Let’s take a peek at all 37 results on one image from the test set.
A 3D Approach for Computer-Aided Liver Lesion Detection Reed Tompkins DePaul Medix Program 2008 Mentor: Kenji Suzuki, Ph.D. Special Thanks to Edmund Ng.
Canny Edge Detector1 1)Smooth image with a Gaussian optimizes the trade-off between noise filtering and edge localization 2)Compute the Gradient magnitude.
Color a* b* Brightness L* Texture Original Image Features Feature combination E D 22 Boundary Processing Textons A B C A B C 22 Region Processing.
Highlights Lecture on the image part (10) Automatic Perception 16
Stockman MSU/CSE Fall 2009 Finding region boundaries.
Robust estimation Problem: we want to determine the displacement (u,v) between pairs of images. We are given 100 points with a correlation score computed.
1 Lines and Arcs Segmentation In some image sets, lines, curves, and circular arcs are more useful than regions or helpful in addition to regions. Lines.
A Vision-Based System that Detects the Act of Smoking a Cigarette Xiaoran Zheng, University of Nevada-Reno, Dept. of Computer Science Dr. Mubarak Shah,
Tal Mor  Create an automatic system that given an image of a room and a color, will color the room walls  Maintaining the original texture.
Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean Hall 5409 T-R 10:30am – 11:50am.
October 8, 2013Computer Vision Lecture 11: The Hough Transform 1 Fitting Curve Models to Edges Most contours can be well described by combining several.
MASKS © 2004 Invitation to 3D vision Lecture 3 Image Primitives andCorrespondence.
Chapter 10: Image Segmentation
National Center for Supercomputing Applications University of Illinois at Urbana-Champaign Image Features Kenton McHenry, Ph.D. Research Scientist.
GM-Carnegie Mellon Autonomous Driving CRL TitleAutomated Image Analysis for Robust Detection of Curbs Thrust AreaPerception Project LeadDavid Wettergreen,
Lecture 19 Representation and description II
Prakash Chockalingam Clemson University Non-Rigid Multi-Modal Object Tracking Using Gaussian Mixture Models Committee Members Dr Stan Birchfield (chair)
Mean-shift and its application for object tracking
Digital Image Processing Lecture 20: Representation & Description
Digital Image Processing CCS331 Relationships of Pixel 1.
Automatic Minirhizotron Root Image Analysis Using Two-Dimensional Matched Filtering and Local Entropy Thresholding Presented by Guang Zeng.
Chapter 10, Part II Edge Linking and Boundary Detection The methods discussed in the previous section yield pixels lying only on edges. This section.
CS654: Digital Image Analysis Lecture 25: Hough Transform Slide credits: Guillermo Sapiro, Mubarak Shah, Derek Hoiem.
Scene Completion Using Millions of Photographs James Hays, Alexei A. Efros Carnegie Mellon University ACM SIGGRAPH 2007.
1 Research Question  Can a vision-based mobile robot  with limited computation and memory,  and rapidly varying camera positions,  operate autonomously.
Image-Based Segmentation of Indoor Corridor Floors for a Mobile Robot
Image-Based Segmentation of Indoor Corridor Floors for a Mobile Robot Yinxiao Li and Stanley T. Birchfield The Holcombe Department of Electrical and Computer.
Course14 Dynamic Vision. Biological vision can cope with changing world Moving and changing objects Change illumination Change View-point.
October 16, 2014Computer Vision Lecture 12: Image Segmentation II 1 Hough Transform The Hough transform is a very general technique for feature detection.
By Pushpita Biswas Under the guidance of Prof. S.Mukhopadhyay and Prof. P.K.Biswas.
Scale Invariant Feature Transform (SIFT)
Sketching an Isometric Circle © 2012 Project Lead The Way, Inc.Introduction to Engineering Design.
1 Overview representing region in 2 ways in terms of its external characteristics (its boundary)  focus on shape characteristics in terms of its internal.
Face Detection Final Presentation Mark Lee Nic Phillips Paul Sowden Andy Tait 9 th May 2006.
Face Detection Using Color Thresholding and Eigenimage Template Matching Diederik Marius Sumita Pennathur Klint Rose.
Computer Vision Image Features Instructor: Dr. Sherif Sami Lecture 4.
Person Following with a Mobile Robot Using Binocular Feature-Based Tracking Zhichao Chen and Stanley T. Birchfield Dept. of Electrical and Computer Engineering.
Tracking Hands with Distance Transforms Dave Bargeron Noah Snavely.
Color Image Segmentation Mentor : Dr. Rajeev Srivastava Students: Achit Kumar Ojha Aseem Kumar Akshay Tyagi.
MASKS © 2004 Invitation to 3D vision Lecture 3 Image Primitives andCorrespondence.
Whole Slide Image Stitching for Osteosarcoma detection Ovidiu Daescu Colaborators: Bogdan Armaselu and Harish Babu Arunachalam University of Texas at Dallas.
Computer Graphics CC416 Lecture 04: Bresenham Line Algorithm & Mid-point circle algorithm Dr. Manal Helal – Fall 2014.
EE368 Final Project Spring 2003
CSSE463: Image Recognition Day 21
Lecture 26 Hand Pose Estimation Using a Database of Hand Images
Fitting Curve Models to Edges
Fall 2012 Longin Jan Latecki
CSSE463: Image Recognition Day 23
PRAKASH CHOCKALINGAM, NALIN PRADEEP, AND STAN BIRCHFIELD
CSSE463: Image Recognition Day 23
CSSE463: Image Recognition Day 23
Finding Line and Curve Segments from Edge Images
Presentation transcript:

Cynthia Atherton

 Methodology  Code  Results  Problems  Plans

“Hand Detection and Segmentation in Cluttered Environments” by Christopher Schwarz and Niels da Vitoria Lobo School of Computer Science, University of Central Florida, Orlando, FL

 Hand tracking system  Detect and segment straight fingered hands ▪ Any complex background ▪ All reasonable lighting conditions ▪ Single frame analysis  Existing systems ▪ Work with silhouettes ▪ Work under normal lighting conditions

 Preprocessing  Detecting candidate fingers  Grouping finger detections into candidate hand detections  Post-processing candidate hand groups  Generating output

 Break down image into lines and curves  Search for a pair of nearly parallel lines and a fingertip curve to constitute a candidate finger  Run Kanade-Lucas-Tomasi (KLT) Feature Tracker to find locations of textured regions

Combination of Burns Line Finder and Canny Edge Detection Curvefinder software is separate program written by Jan Prokaj

Used in phase 4 to strengthen the detection confidence in finger and hand detections in regions of low texture and weaken those in regions of more complex texture.

 Build the initial candidate list  Remove duplicates  Correct bases  Reapply Area Tests

 Tip is found correctly, but base does not extend to location where finger meets palm  Method of base correction on each finger:  Sample gradient magnitude in region around original base point.  Move sampling bounding box along median line past the original base in increments of several pixels.  Compare strength of data in region to previous.  Assume new base when magnitude drastically change.

 When a finger is extended through base correction, should the original finger be discarded?  Apply length-to-width ratio to original  If ratio is in range, keep original and add duplicate detection with “corrected” base.

 Form initial groups  Score groups for correctness  Reinstate candidates  Remove false positive hand groups  Merge similar hand groups  Remove fingers from hand groups Repeat once before continuing to phase 4

 To get an estimated palm center: 1. Draw a ray along the medial axis of the finger through the center of its base and beyond 2. Take a point in the ray estimated as the palm center by following it for a distance past the base that is a percentage of the length of the finger (0.6x)

 To group candidate fingers into candidate hands:  2 candidate fingers are connected if they meet several criteria, for example: ▪ Similar median brightness values ▪ Estimated palm centers are close (Euclidean distance)  Results in cliques of fingers

 For a detected hand group  Average all of the estimated palm centers for the fingers to get the palm center  Estimate palm region as a circle around the center, with a radius proportion to the average length of the detected fingers

 2 levels of promotion  Promotion 1 ▪ Stronger method of promotion ▪ Candidate must match every finger in the group  Promotion 2 ▪ Candidate’s tip-base median ray must come within some distance of group’s palm radius ▪ Candidate must point in same direction as other fingers in group

 Correct palm center locations  Reapply Remove fingers from hand groups  Calculate openness rating of each group  Reapply Remove false positive hand groups  Remove false positive groups according to the positions of others  Reapply Correct palm center locations

 Improve location of palm center by looking for internal wedges  Curves found in negative space of hand and open fingers  Points along perimeter of the palm  Wedges used to nudge original palm center in the right direction

 Detected hands  Pink – palm center  Blue – detected fingers  Green – Maybe class

 Curvefinder written in C by Jan Prokaj  KLT written in C by Stan Birchfield of Clemson University  Line sketch/Finger finder written in Java by Chris Schwarz  Curve sketches generated prior to running Fingerfinder

 System is good at detecting palm locations, but not straight fingers.  Curvefinder not designed to run on Windows  Learning how to run Linux image in VMWare Player

 Curved fingers  Finding fingers using silhouettes and AdaBoosting  Get with Dr. Lobo for info on head detection  Learn about AdaBoosting  Apply new method for finger detection