Human Body Shape Estimation from Single Image Moin Nabi Computer Vision Lab. ©IPM - Dec. 2009.

Slides:



Advertisements
Similar presentations
Image Modeling & Segmentation
Advertisements

The fundamental matrix F
RGB-D object recognition and localization with clutter and occlusions Federico Tombari, Samuele Salti, Luigi Di Stefano Computer Vision Lab – University.
Caroline Rougier, Jean Meunier, Alain St-Arnaud, and Jacqueline Rousseau IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 21, NO. 5,
Exploration of bump, parallax, relief and displacement mapping
Human Identity Recognition in Aerial Images Omar Oreifej Ramin Mehran Mubarak Shah CVPR 2010, June Computer Vision Lab of UCF.
Digital Interactive Entertainment Dr. Yangsheng Wang Professor of Institute of Automation Chinese Academy of Sciences
Face Alignment with Part-Based Modeling
Learning to estimate human pose with data driven belief propagation Gang Hua, Ming-Hsuan Yang, Ying Wu CVPR 05.
Modeling the Shape of People from 3D Range Scans
3D Human Body Pose Estimation from Monocular Video Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)
Automatic Feature Extraction for Multi-view 3D Face Recognition
Computer Vision Detecting the existence, pose and position of known objects within an image Michael Horne, Philip Sterne (Supervisor)
3D Face Modeling Michaël De Smet.
International Conference on Automatic Face and Gesture Recognition, 2006 A Layered Deformable Model for Gait Analysis Haiping Lu, K.N. Plataniotis and.
Cambridge, Massachusetts Pose Estimation in Heavy Clutter using a Multi-Flash Camera Ming-Yu Liu, Oncel Tuzel, Ashok Veeraraghavan, Rama Chellappa, Amit.
Multiple People Detection and Tracking with Occlusion Presenter: Feifei Huo Supervisor: Dr. Emile A. Hendriks Dr. A. H. J. Stijn Oomes Information and.
As applied to face recognition.  Detection vs. Recognition.
AAM based Face Tracking with Temporal Matching and Face Segmentation Dalong Du.
Snakes with Some Math.
On Constrained Optimization Approach To Object Segmentation Chia Han, Xun Wang, Feng Gao, Zhigang Peng, Xiaokun Li, Lei He, William Wee Artificial Intelligence.
A Robust Pedestrian Detection Approach Based on Shapelet Feature and Haar Detector Ensembles Wentao Yao, Zhidong Deng TSINGHUA SCIENCE AND TECHNOLOGY ISSNl.
Research Report FWF S9206 Helmut Pottmann Geometric Modeling & Industrial Geometry.
Real-time Embedded Face Recognition for Smart Home Fei Zuo, Student Member, IEEE, Peter H. N. de With, Senior Member, IEEE.
A Study of Approaches for Object Recognition
3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)
Human Posture Recognition with Convex Programming Hao Jiang, Ze-Nian Li and Mark S. Drew School of Computing Science Simon Fraser University Burnaby, BC,
MVL (Machine Vision Lab) UIC HUMAN MOTION VIDEO DATABASE Jezekiel Ben-Arie ECE Department University Of Illinois at Chicago Scripts, Queries, Recognition.
Multi-camera Tracking of Articulated Human Motion using Motion and Shape Cues Aravind Sundaresan and Rama Chellappa Center for Automation Research University.
The Terrapins Computer Vision Laboratory University of Maryland.
Human Identification using Silhouette Gait Data Rutgers University Chan-Su Lee.
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.
David Luebke Modeling and Rendering Architecture from Photographs A hybrid geometry- and image-based approach Debevec, Taylor, and Malik SIGGRAPH.
00/4/103DVIP-011 Part Three: Descriptions of 3-D Objects and Scenes.
Distinctive Image Features from Scale-Invariant Keypoints By David G. Lowe, University of British Columbia Presented by: Tim Havinga, Joël van Neerbos.
CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu Lecture 35 – Review for midterm.
Action and Gait Recognition From Recovered 3-D Human Joints IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS— PART B: CYBERNETICS, VOL. 40, NO. 4, AUGUST.
Computer Graphics Group Tobias Weyand Mesh-Based Inverse Kinematics Sumner et al 2005 presented by Tobias Weyand.
Image Recognition using Hierarchical Temporal Memory Radoslav Škoviera Ústav merania SAV Fakulta matematiky, fyziky a informatiky UK.
13 th International Fall Workshop VISION, MODELING, AND VISUALIZATION 2008 October 8-10, 2008 Konstanz, Germany Strike a Pose Image-Based Pose Synthesis.
Xiaoguang Han Department of Computer Science Probation talk – D Human Reconstruction from Sparse Uncalibrated Views.
Exploitation of 3D Video Technologies Takashi Matsuyama Graduate School of Informatics, Kyoto University 12 th International Conference on Informatics.
ALIGNMENT OF 3D ARTICULATE SHAPES. Articulated registration Input: Two or more 3d point clouds (possibly with connectivity information) of an articulated.
Computer Vision Michael Isard and Dimitris Metaxas.
Vision-based human motion analysis: An overview Computer Vision and Image Understanding(2007)
P RW GEI: Poisson Random Walk based Gait Recognition Intelligent Systems Research Centre School of Computing and Intelligent Systems,
Rick Parent - CIS681 Motion Analysis – Human Figure Processing video to extract information of objects Motion tracking Pose reconstruction Motion and subject.
A split-and-merge framework for 2D shape summarization D. Gerogiannis, C. Nikou and A. Likas Department of Computer Science, University of Ioannina, Greece.
Vision and Obstacle Avoidance In Cartesian Space.
3D Face Recognition Using Range Images
Visual Odometry David Nister, CVPR 2004
Silhouette Segmentation in Multiple Views Wonwoo Lee, Woontack Woo, and Edmond Boyer PAMI, VOL. 33, NO. 7, JULY 2011 Donguk Seo
Spring 2014 CS274: Automatic Rigging
Computer Vision Computer Vision based Hole Filling Chad Hantak COMP December 9, 2003.
MASKS © 2004 Invitation to 3D vision Lecture 3 Image Primitives andCorrespondence.
Level Set Segmentation ~ 9.37 Ki-Chang Kwak.
Demo.
Range Image Segmentation for Modeling and Object Detection in Urban Scenes Cecilia Chen & Ioannis Stamos Computer Science Department Graduate Center, Hunter.
Real-Time Human Pose Recognition in Parts from Single Depth Image
Dynamical Statistical Shape Priors for Level Set Based Tracking
A Tutorial on HOG Human Detection
Computer Animation and Visualisation Lecture 4. Skinning
“The Truth About Cats And Dogs”
Outline H. Murase, and S. K. Nayar, “Visual learning and recognition of 3-D objects from appearance,” International Journal of Computer Vision, vol. 14,
Image processing and computer vision
Liyuan Li, Jerry Kah Eng Hoe, Xinguo Yu, Li Dong, and Xinqi Chu
Descriptions of 3-D Objects and Scenes
Saliency Optimization from Robust Background Detection
High-Level Vision Object Recognition II.
Artistic Rendering Final Project Initial Proposal
Presentation transcript:

Human Body Shape Estimation from Single Image Moin Nabi Computer Vision Lab. ©IPM - Dec. 2009

Computer Vision Lab. Problem Background Pose + Shape Simultanesly

Computer Vision Lab. Application Entertainment: Animation, Games Clinical: Rehabilitation medicine Security: Surveillance Understanding: Gesture/Activity recognition

Computer Vision Lab. Problem Difficulties ■ Lose of depth information in 2D image projections ■ The bones and joints are observable indirectly (obstructed by clothing) ■ Occlusions ■ High dimensionality of the state space

Computer Vision Lab. Overview of Approach

Computer Vision Lab. Body Model and Fitting Using SCAPE: A deformable, triangulated mesh model.

Computer Vision Lab. Pose Initialization ? various values of the s

Computer Vision Lab. Region-based Segmentation GrabCut : Initial Silhouette initial pose and average shape projected into image. Iterative Tri-map extraction by erosion and dilation. [Demo!]

Computer Vision Lab. Internal Edges standard edge detector. Apply distance transform to define edge cost map normalized to [0, 1]. Define edge cost Function.

Computer Vision Lab. Height Constrained Optimization

Computer Vision Lab. Body Shape from Shading

Computer Vision Lab. Optimization – Step by Step

Computer Vision Lab. Optimization – Step by Step

Computer Vision Lab. Optimization – Step by Step

Computer Vision Lab. Optimization – Step by Step

Computer Vision Lab. Optimization – Step by Step

Computer Vision Lab. Optimization – Step by Step

Computer Vision Lab. Experimental Result

Computer Vision Lab. Experimental Result SE:Silluate+Edge, SES:Silluate+Edge+Shade, GT:Ground Truth

Computer Vision Lab. The Evolution of Man

Computer Vision Lab. Any Question?