1. Human Body Shape Estimation from Single Image Moin Nabi Computer Vision Lab. ©IPM - Dec. 2009

2. Computer Vision Lab. Problem Background Pose + Shape Simultanesly

3. Computer Vision Lab. Application Entertainment: Animation, Games Clinical: Rehabilitation medicine Security: Surveillance Understanding: Gesture/Activity recognition

4. Computer Vision Lab. Problem Difficulties ■ Lose of depth information in 2D image projections ■ The bones and joints are observable indirectly (obstructed by clothing) ■ Occlusions ■ High dimensionality of the state space

5. Computer Vision Lab. Overview of Approach

6. Computer Vision Lab. Body Model and Fitting Using SCAPE: A deformable, triangulated mesh model.

7. Computer Vision Lab. Pose Initialization ? various values of the s

8. Computer Vision Lab. Region-based Segmentation GrabCut : Initial Silhouette initial pose and average shape projected into image. Iterative Tri-map extraction by erosion and dilation. [Demo!]

9. Computer Vision Lab. Internal Edges standard edge detector. Apply distance transform to define edge cost map normalized to [0, 1]. Define edge cost Function.

10. Computer Vision Lab. Height Constrained Optimization

11. Computer Vision Lab. Body Shape from Shading

12. Computer Vision Lab. Optimization – Step by Step

13. Computer Vision Lab. Optimization – Step by Step

14. Computer Vision Lab. Optimization – Step by Step

15. Computer Vision Lab. Optimization – Step by Step

16. Computer Vision Lab. Optimization – Step by Step

17. Computer Vision Lab. Optimization – Step by Step

18. Computer Vision Lab. Experimental Result

19. Computer Vision Lab. Experimental Result SE:Silluate+Edge, SES:Silluate+Edge+Shade, GT:Ground Truth

20. Computer Vision Lab. The Evolution of Man 20092000 1996

21. Computer Vision Lab. Any Question?