Scalable Salient Motions Detection from Skeletal Motion Capture Data Samah Ramadan

Outline Introduction Introduction Literature Review Literature Review Singular Value Decomposition Singular Value Decomposition Salient Motion Detection Salient Motion Detection Results Results Conclusions Conclusions

Introduction Applications of human motion analysis Applications of human motion analysis Reconstruction of 3D models of humans Reconstruction of 3D models of humans Gait analysis and activity recognition Gait analysis and activity recognition Motion capture Motion capture Growing need for compact motion representation Growing need for compact motion representation Motion summarization Motion summarization Key frame extraction Key frame extraction

Literature Review Hand-drawn illustrations, storyboards and comic books Hand-drawn illustrations, storyboards and comic books Speedlines, flow ribbons and opacity modulation Speedlines, flow ribbons and opacity modulation Dynamic Glyphs Dynamic Glyphs Streamline placement Streamline placement Curve simplification Curve simplification Replicated multidimensional scaling Replicated multidimensional scaling

Singular Value Decomposition

Salient Motion Detection Human Joint Configuration

Salient Motion Detection BVH Files BVH Files HIERARCHY ROOT Hips { OFFSET CHANNELS 6 Xposition Yposition Zposition Zrotation Xrotation Yrotation JOINT Chest { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation JOINT Neck { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation JOINT Head { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation End Site { OFFSET } JOINT LeftCollar { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation JOINT LeftUpArm { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation JOINT LeftLowArm {

OFFSET CHANNELS 3 Zrotation Xrotation Yrotation JOINT LeftHand { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation End Site { OFFSET } JOINT RightCollar { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation JOINT RightUpArm { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation JOINT RightLowArm { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation JOINT RightHand { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation End Site { OFFSET } JOINT LeftUpLeg { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation JOINT LeftLowLeg { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation JOINT LeftFoot {

OFFSET CHANNELS 3 Zrotation Xrotation Yrotation End Site { OFFSET } JOINT RightUpLeg { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation JOINT RightLowLeg { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation JOINT RightFoot { OFFSET CHANNELS 3 Zrotation Xrotation Yrotation End Site { OFFSET } MOTION Frames: 2 Frame Time:

Salient Motion Detection

Sliding Window SVD Sliding Window SVD x i-N+1 x i-N+2 …….. x i x i+1 …….. x T Window size N Compute SVD and get the rank r i

Salient Motion Detection Sliding Window SVD Sliding Window SVD x i-N+1 x i-N+2 …….. x i x i+1 …….. x T Window size N Compute SVD and get the rank r i+1

Salient Motion Detection

Joint angels feature vector Joint angels feature vector Salient Motion Detection Absolute location feature vector Absolute location feature vector

Salient Motion Detection

Results Code, paper and data Code, paper and data otionProject.htm otionProject.htm

Conclusions Extracting salient motion is an important problem in computer graphics, computer vision, etc. Extracting salient motion is an important problem in computer graphics, computer vision, etc. SVD can be used to extract salient motion frames SVD can be used to extract salient motion frames Absolute position features are better than joint angle features in representing the motion. Absolute position features are better than joint angle features in representing the motion.

Acknowledgment Dr. Amitabh Varshney Dr. Amitabh Varshney Dr. Dianne O’Leary Dr. Dianne O’Leary Youngmin Kim Youngmin Kim