1. 3D Motion Classification Partial Image Retrieval and Download
Multimedia Project
Multimedia and Network Lab, Department of Computer Science

2. Sensors and 3D motion capture system
Electrocardiogram
Electromyogram
Accelerometer
UTD Multimedia and Networking Lab
5/29/2018

3. 3D Motion Capture
UTD Multimedia and Networking Lab
5/29/2018

4. Integration Analysis Motion correlation and error modeling
Gait Analysis
Motion correlation and error modeling
Humanoid robotics
Game Control
Disease diagnostic
Motion Classification
Clustering
UTD Multimedia and Networking Lab
5/29/2018

5. 3D Input Data (MoCap & EMG)
EMG data
3D Mocap data
M x 54 Matrix ( M is the total num of Frames )
UTD Multimedia and Networking Lab
5/29/2018

6. Input Data Format Each Motion is represented by set of joint vectors
Use sliding Windows for feature extractions
Tibia
Foot
Toe
Windows (Time Frame)
UTD Multimedia and Networking Lab
5/29/2018

7. Image data
UTD Multimedia and Networking Lab
5/29/2018

8. Data Analysis Feature Extraction Data Analysis Data Collection
Preprocessing
Feature Extraction
Data Analysis
Geometric Trans.
Motion capture
Cross-Pair
24 Feature
Point
Gait Cycle

9. UTD Multimedia and Networking Lab 5/29/2018
Project I: Object Semantics in Image
Project II: Image Downloader
Project III: 3D image Classification
UTD Multimedia and Networking Lab
5/29/2018

10. Project: Object Semantics in Image
+ =
Project: Object Semantics in Image
Template-match based object semantics
Template-match
UTD Multimedia and Networking Lab
5/29/2018

11. SURF(Speeded Up Robust Features)
Image template
Input Image
SURF(Speeded Up Robust Features)
SIFT(Scale-invariant feature transfrom)
HOG(Histogram of Gradients) ….
Visual image semantic
UTD Multimedia and Networking Lab
5/29/2018

12. Project Goal
Goal: Building Visual Image Semantics using template-match based approach.
Input: Image data(2D)
Training Data : Partial Image data(2D)
Output: related Spatial data(2D, Visual Image Semantics)
Requirement:
Language option: anything
UTD Multimedia and Networking Lab
5/29/2018

13. Project: Annotated Image based Image (and Video) Downloader
DB- Flickr, Goolge Image…
UTD Multimedia and Networking Lab
5/29/2018

14. MIT Labelme project (Image tagging)
UTD Multimedia and Networking Lab
5/29/2018

15. Image Tagging (Annotation)
Query Image
Image Tagging (Annotation)
Download images
google
Flickr
Word based
image search
UTD Multimedia and Networking Lab
5/29/2018

16. Project Goal (II) Goal: Building Content based Image Downloader
Input: Image data(2D)
Training Data : Labelme Image DB
Output: collections of related Spatial data(2D)
Requirement:
Language option: anything
Lableme matlab toolbox:
UTD Multimedia and Networking Lab
5/29/2018

17. Project: 3D motion classification using Mocap data template
Mocap clustering and detection
Mocap based motion template
Object tracking
Classification
3D image (image sequence)
UTD Multimedia and Networking Lab
5/29/2018

18. Project Goal Goal: Cluster each motion using any machine leaning
techniques to form a set of motions to decide
3D image motion set.
Window size: 360 frames with 108 frames overlapping
Input: Image Sequence data(3D)
Training Data : Mocap data (54D)
Output: Segmented image sequence data(3D)
Requirement:
Language option: anything
UTD Multimedia and Networking Lab
5/29/2018

19. Duk-Jin Kim duk-jin.kim@utdallas.edu @ECSS 4.416 Thank You ! Question?
UTD Multimedia and Networking Lab
5/29/2018