Human Body Shape Estimation from Single Image Moin Nabi Computer Vision Lab. ©IPM - Dec. 2009
Computer Vision Lab. Problem Background Pose + Shape Simultanesly
Computer Vision Lab. Application Entertainment: Animation, Games Clinical: Rehabilitation medicine Security: Surveillance Understanding: Gesture/Activity recognition
Computer Vision Lab. Problem Difficulties ■ Lose of depth information in 2D image projections ■ The bones and joints are observable indirectly (obstructed by clothing) ■ Occlusions ■ High dimensionality of the state space
Computer Vision Lab. Overview of Approach
Computer Vision Lab. Body Model and Fitting Using SCAPE: A deformable, triangulated mesh model.
Computer Vision Lab. Pose Initialization ? various values of the s
Computer Vision Lab. Region-based Segmentation GrabCut : Initial Silhouette initial pose and average shape projected into image. Iterative Tri-map extraction by erosion and dilation. [Demo!]
Computer Vision Lab. Internal Edges standard edge detector. Apply distance transform to define edge cost map normalized to [0, 1]. Define edge cost Function.
Computer Vision Lab. Height Constrained Optimization
Computer Vision Lab. Body Shape from Shading
Computer Vision Lab. Optimization – Step by Step
Computer Vision Lab. Optimization – Step by Step
Computer Vision Lab. Optimization – Step by Step
Computer Vision Lab. Optimization – Step by Step
Computer Vision Lab. Optimization – Step by Step
Computer Vision Lab. Optimization – Step by Step
Computer Vision Lab. Experimental Result
Computer Vision Lab. Experimental Result SE:Silluate+Edge, SES:Silluate+Edge+Shade, GT:Ground Truth
Computer Vision Lab. The Evolution of Man
Computer Vision Lab. Any Question?