International Conference on Automatic Face and Gesture Recognition, 2006 A Layered Deformable Model for Gait Analysis Haiping Lu, K.N. Plataniotis and.

Slides:

Advertisements

Similar presentations

Using Strong Shape Priors for Multiview Reconstruction Yunda SunPushmeet Kohli Mathieu BrayPhilip HS Torr Department of Computing Oxford Brookes University.

Advertisements

1 Hierarchical Part-Based Human Body Pose Estimation * Ramanan Navaratnam * Arasanathan Thayananthan Prof. Phil Torr * Prof. Roberto Cipolla * University.

Evidential modeling for pose estimation Fabio Cuzzolin, Ruggero Frezza Computer Science Department UCLA.

Real-Time Dynamic Wrinkles Caroline Larboulette Marie-Paule Cani GRAVIR Lab, Grenoble, France.

Recovering Human Body Configurations: Combining Segmentation and Recognition Greg Mori, Xiaofeng Ren, and Jitentendra Malik (UC Berkeley) Alexei A. Efros.

- Recovering Human Body Configurations: Combining Segmentation and Recognition (CVPR’04) Greg Mori, Xiaofeng Ren, Alexei A. Efros and Jitendra Malik -

Face Alignment with Part-Based Modeling

Database-Based Hand Pose Estimation CSE 6367 – Computer Vision Vassilis Athitsos University of Texas at Arlington.

Automating Graph-Based Motion Synthesis Lucas Kovar Michael Gleicher University of Wisconsin-Madison.

Performance Evaluation Measures for Face Detection Algorithms Prag Sharma, Richard B. Reilly DSP Research Group, Department of Electronic and Electrical.

Modeling 3D Deformable and Articulated Shapes Yu Chen, Tae-Kyun Kim, Roberto Cipolla Department of Engineering University of Cambridge.

Student: Yao-Sheng Wang Advisor: Prof. Sheng-Jyh Wang ARTICULATED HUMAN DETECTION 1 Department of Electronics Engineering National Chiao Tung University.

Shape and Dynamics in Human Movement Analysis Ashok Veeraraghavan.

Introduction to Data-driven Animation Jinxiang Chai Computer Science and Engineering Texas A&M University.

Shape and Dynamics in Human Movement Analysis Ashok Veeraraghavan.

A Study of Approaches for Object Recognition

Face Detection: a Survey Speaker: Mine-Quan Jing National Chiao Tung University.

Recognition of Human Gait From Video Rong Zhang, C. Vogler, and D. Metaxas Computational Biomedicine Imaging and Modeling Center Rutgers University.

Incremental Learning of Temporally-Coherent Gaussian Mixture Models Ognjen Arandjelović, Roberto Cipolla Engineering Department, University of Cambridge.

Learning the space of time warping functions for Activity Recognition Function-Space of an Activity Ashok Veeraraghavan Rama Chellappa Amit K. Roy-Chowdhury.

Gait Recognition Simon Smith Jamie Hutton Thomas Moore David Newman.

Jacinto C. Nascimento, Member, IEEE, and Jorge S. Marques

Hand Signals Recognition from Video Using 3D Motion Capture Archive Tai-Peng Tian Stan Sclaroff Computer Science Department B OSTON U NIVERSITY I. Introduction.

Image Subtraction for Real Time Moving Object Extraction Shahbe Mat Desa, Qussay A. Salih, CGIV’04.

Action and Gait Recognition From Recovered 3-D Human Joints IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS— PART B: CYBERNETICS, VOL. 40, NO. 4, AUGUST.

Body Expression of Emotion (BEE)

Abstract Developing sign language applications for deaf people is extremely important, since it is difficult to communicate with people that are unfamiliar.

Privacy Protection for Life-log Video Jayashri Chaudhari, Sen-ching S. Cheung, M. Vijay Venkatesh Department of Electrical and Computer Engineering Center.

13 th International Fall Workshop VISION, MODELING, AND VISUALIZATION 2008 October 8-10, 2008 Konstanz, Germany Strike a Pose Image-Based Pose Synthesis.

A Method for Hand Gesture Recognition Jaya Shukla Department of Computer Science Shiv Nadar University Gautam Budh Nagar, India Ashutosh Dwivedi.

General Tensor Discriminant Analysis and Gabor Features for Gait Recognition by D. Tao, X. Li, and J. Maybank, TPAMI 2007 Presented by Iulian Pruteanu.

Image-based Plant Modeling Zeng Lanling Mar 19, 2008.

Gait Recognition Guy Bar-hen Tal Reis. Introduction Gait – is defined as a “manner of walking”. Gait recognition – –is the term typically used to refer.

Multimodal Information Analysis for Emotion Recognition

Self-Calibration and Metric Reconstruction from Single Images Ruisheng Wang Frank P. Ferrie Centre for Intelligent Machines, McGill University.

5. SUMMARY & CONCLUSIONS We have presented a coarse to fine minimization framework using a coupled dual ellipse model to form a subspace constraint that.

A Comparative Evaluation of Three Skin Color Detection Approaches Dennis Jensch, Daniel Mohr, Clausthal University Gabriel Zachmann, University of Bremen.

A New Fingertip Detection and Tracking Algorithm and Its Application on Writing-in-the-air System The th International Congress on Image and Signal.

Tracking People by Learning Their Appearance Deva Ramanan David A. Forsuth Andrew Zisserman.

International Conference on Pattern Recognition, Hong Kong, August Multilinear Principal Component Analysis of Tensor Objects for Recognition Haiping.

Vision-based human motion analysis: An overview Computer Vision and Image Understanding(2007)

1 Research Question  Can a vision-based mobile robot  with limited computation and memory,  and rapidly varying camera positions,  operate autonomously.

Action and Gait Recognition From Recovered 3-D Human Joints IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS— PART B: CYBERNETICS, VOL. 40, NO. 4, AUGUST.

Benjamin Stephens Carnegie Mellon University Monday June 29, 2009 The Linear Biped Model and Application to Humanoid Estimation and Control.

Human Re-identification by Matching Compositional Template with Cluster Sampling Yuanlu Xu 1, Liang Lin 1, Wei-Shi Zheng 1, Xiaobai Liu 2 Abstract This.

P RW GEI: Poisson Random Walk based Gait Recognition Intelligent Systems Research Centre School of Computing and Intelligent Systems,

Human Activity Recognition at Mid and Near Range Ram Nevatia University of Southern California Based on work of several collaborators: F. Lv, P. Natarajan,

CS-378: Game Technology Lecture #15.5: Physically Based Simulation Prof. Okan Arikan University of Texas, Austin Thanks to James O’Brien, Steve Chenney,

Face Detection Using Skin Color and Gabor Wavelet Representation Information and Communication Theory Group Faculty of Information Technology and System.

Introduction to Related Papers of Vessel Segmentation Methods Advisor : Ku-Yaw Chang Student : Wei-Lu Lin 2015/1/7.

High Resolution Surface Reconstruction from Overlapping Multiple-Views

Human Activity Recognition, Biometrics and Cybersecurity Mohamed Abdel-Mottaleb, Ph.D. Image Processing and Computer Vision Department of Electrical and.

Using decision trees to build an a framework for multivariate time- series classification 1 Present By Xiayi Kuang.

Tracking Groups of People for Video Surveillance Xinzhen(Elaine) Wang Advisor: Dr.Longin Latecki.

Multi-view Synchronization of Human Actions and Dynamic Scenes Emilie Dexter, Patrick Pérez, Ivan Laptev INRIA Rennes - Bretagne Atlantique

Motion Segmentation at Any Speed Shrinivas J. Pundlik Department of Electrical and Computer Engineering, Clemson University, Clemson, SC.

Detection, Tracking and Recognition in Video Sequences Supervised By: Dr. Ofer Hadar Mr. Uri Perets Project By: Sonia KanOra Gendler Ben-Gurion University.

Jeopardy Terminology Quiz Geometry All points on a circle are the same distance from this point. (100)

Machine learning & object recognition Cordelia Schmid Jakob Verbeek.

Date of download: 7/8/2016 Copyright © ASME. All rights reserved. From: Stabilization of a Dynamic Walking Gait Simulation J. Comput. Nonlinear Dynam.

Gait Recognition Gökhan ŞENGÜL.

Lecture 26 Hand Pose Estimation Using a Database of Hand Images

Computer Vision, Robotics, Machine Learning and Control Lab

Real-Time Human Pose Recognition in Parts from Single Depth Image

Object Recognition in the Dynamic Link Architecture

Cheng-Ming Huang, Wen-Hung Liao Department of Computer Science

Segmentation of cardiac MRI using particle filters

Synthesis of Motion from Simple Animations

An Infant Facial Expression Recognition System Based on Moment Feature Extraction C. Y. Fang, H. W. Lin, S. W. Chen Department of Computer Science and.

Liyuan Li, Jerry Kah Eng Hoe, Xinguo Yu, Li Dong, and Xinqi Chu

Presentation transcript:

International Conference on Automatic Face and Gesture Recognition, 2006 A Layered Deformable Model for Gait Analysis Haiping Lu, K.N. Plataniotis and A.N. Venetsanopoulos The Edward S. Rogers Sr. Department of Electrical and Computer Engineering University of Toronto

Haiping Lu FG2006, Southampton, UK 2 Outline Motivation Overview The layered deformable model (LDM) LDM body pose recovery Experimental results Conclusions

Haiping Lu FG2006, Southampton, UK 3 Motivation Automated Human identification at a distance Visual surveillance and monitoring applications Banks, parking lots, airports, etc. USF HumanID Gait Challenge problem Articulated human body model for gait recognition Manually labeled silhouettes Layered, deformable

Haiping Lu FG2006, Southampton, UK 4 Overview Manual labeling LDM recovery Automatic extraction LDM recovery

Haiping Lu FG2006, Southampton, UK 5 The Layered Deformable Model (LDM) Trade-off: Complexity Vs. descriptiveness Match manual labeling: Close to human’s subjective perception Assumptions: Fronto-parallel, from right to left.

Haiping Lu FG2006, Southampton, UK 6 LDM – 22 Parameters Ten segments Static: Lengths (6) Widths (3) Dynamic Positions (4) Angles (9)

Haiping Lu FG2006, Southampton, UK 7 LDM –Layers and deformation Four layers Deformation:

Haiping Lu FG2006, Southampton, UK 8 LDM – Summary Summary: Realistic with moderate complexity Compact: 13 dynamic parameters Layered: model self-occlusion Deformable: realistic limbs Resemblance to manual labeling

Haiping Lu FG2006, Southampton, UK 9 Manual silhouettes pose estimation (ground truth & statistics) Limb joint angles: Reliable edge orientation Spatial–Orientation mean-shift (mode- seeking): dominant modes  limb orientation Others: Joint positions, limb widths and lengths Simple geometry Torso: bounding box: Head: “head top” and “front face”

Haiping Lu FG2006, Southampton, UK 10 Post-processing Human body constraints: Parameter variation limits Limb angles inter-dependency Temporal smoothing Moving average filtering

Haiping Lu FG2006, Southampton, UK 11 Automatic pose estimation Silhouette extraction (ICME06, Lu, et al.) Static parameters Coarse estimations: statistics from Gallery set Silhouette information extraction based on ideal human proportion: Height, head and waist center, joint spatial- orientation domain modes of limbs

Haiping Lu FG2006, Southampton, UK 12 Ideal proportion of the human eight- head-high figure in drawing

Haiping Lu FG2006, Southampton, UK 13 Automatic pose estimation Dynamic parameters: Geometry on static parameters and silhouette information, constraints. Limb switching detection Thighs & lower legs: variations of angles. Arms: opposite of thighs Frames between successive switch Post-processing: smoothing

Haiping Lu FG2006, Southampton, UK 14 Experimental results 285 sequences from five data sets, one gait cycle each sequence. Imperfection due to silhouette extraction noise and estimation algorithm Feedback LDM recovery to silhouette extraction process may help.

Haiping Lu FG2006, Southampton, UK 15 LDM recovery results Raw LDM manual LDM auto

Haiping Lu FG2006, Southampton, UK 16 LDM recovery example (revisit) Manual labeling LDM recovery Silhouette extraction LDM recovery

Haiping Lu FG2006, Southampton, UK 17 Angle estimation – left & right thighs From manual silhouettesFrom automatically extracted silhouettes

Haiping Lu FG2006, Southampton, UK 18 Error rate (in percentage) for lower limb angles

Haiping Lu FG2006, Southampton, UK 19 Conclusions A layered deformable model for gait analysis 13 Dynamic and 9 static parameters Body pose recovery from manual (ground truth) and automatically extracted silhouettes. Average error rate for lower limb angles: 7% Overall: close match to manual labeling, accurate & efficient model for gait analysis Future work: model-based gait recognition

Haiping Lu FG2006, Southampton, UK 20 Acknowledgement Thanks Prof. Sarkar from the University of South Florida (USF) for providing the manual silhouettes and Gait Challenge data sets.