3D Motion Classification Partial Image Retrieval and Download Multimedia Project Multimedia and Network Lab, Department of Computer Science.

Slides:

Advertisements

Similar presentations

National Technical University of Athens Department of Electrical and Computer Engineering Image, Video and Multimedia Systems Laboratory

Advertisements

Pseudo-Relevance Feedback For Multimedia Retrieval By Rong Yan, Alexander G. and Rong Jin Mwangi S. Kariuki

Mina Emad Azmy Research Assistant – Signal and Image Processing Lab.

Kien A. Hua Division of Computer Science University of Central Florida.

Content-based retrieval of audio Francois Thibault MUMT 614B McGill University.

Vision Based Control Motion Matt Baker Kevin VanDyke.

Real-Time Human Pose Recognition in Parts from Single Depth Images Presented by: Mohammad A. Gowayyed.

Chapter 11 Beyond Bag of Words. Question Answering n Providing answers instead of ranked lists of documents n Older QA systems generated answers n Current.

Image Search Presented by: Samantha Mahindrakar Diti Gandhi.

Automatic Image Annotation and Retrieval using Cross-Media Relevance Models J. Jeon, V. Lavrenko and R. Manmathat Computer Science Department University.

Scaling Content Based Image Retrieval Systems Christine Lo, Sushant Shankar, Arun Vijayvergiya CS 267.

Automatic Image Alignment (feature-based) : Computational Photography Alexei Efros, CMU, Fall 2005 with a lot of slides stolen from Steve Seitz and.

MVL (Machine Vision Lab) UIC HUMAN MOTION VIDEO DATABASE Jezekiel Ben-Arie ECE Department University Of Illinois at Chicago Scripts, Queries, Recognition.

Project IST_1999_ ARTISTE – An Integrated Art Analysis and Navigation Environment Review Meeting N.1: Paris, C2RMF, November 28, 2000 Workpackage.

Video/Image Fingerprinting & Search Naren Chittar CS 223-B project, Winter 2008.

Instructor : Dr. K. R. Rao Presented by: Rajesh Radhakrishnan.

CS 2750 Project Report Jason D. Bakos. Project Goals Data Sensor readings from 11 different people walking in a controlled environment An accelerometer.

Multimedia Data Mining Arvind Balasubramanian Multimedia Lab (ECSS 4.416) The University of Texas at Dallas.

1 Compact Descriptors for Visual Search Lab Multimedia Architecture and Processing Lab (MAPL) Department of Computer Science December, 2014 Hsinchu, Taiwan.

A Brief Overview of Computer Vision Jinxiang Chai.

Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology Mining Rare and Frequent Events in Multi-camera Surveillance.

Image Recognition using Hierarchical Temporal Memory Radoslav Škoviera Ústav merania SAV Fakulta matematiky, fyziky a informatiky UK.

Multimedia Databases (MMDB)

3D Motion Capture Assisted Video human motion recognition based on the Layered HMM Myunghoon Suk & Ashok Ramadass Advisor : Dr. B. Prabhakaran Multimedia.

Multimedia Information Retrieval and Multimedia Data Mining Chengcui Zhang Assistant Professor Dept. of Computer and Information Science University of.

CSCE 5013 Computer Vision Fall 2011 Prof. John Gauch

Computer Vision – Overview Hanyang University Jong-Il Park.

CVPR Workshop on RTV4HCI 7/2/2004, Washington D.C. Gesture Recognition Using 3D Appearance and Motion Features Guangqi Ye, Jason J. Corso, Gregory D. Hager.

DIEGO AGUIRRE COMPUTER VISION INTRODUCTION 1. QUESTION What is Computer Vision? 2.

Research Projects 6v81 Multimedia Database Yohan Jin, T.A.

IBM QBIC: Query by Image and Video Content Jianping Fan Department of Computer Science University of North Carolina at Charlotte Charlotte, NC 28223

Online Kinect Handwritten Digit Recognition Based on Dynamic Time Warping and Support Vector Machine Journal of Information & Computational Science, 2015.

Efficient Visual Object Tracking with Online Nearest Neighbor Classifier Many slides adapt from Steve Gu.

Chapter 5 Multi-Cue 3D Model- Based Object Tracking Geoffrey Taylor Lindsay Kleeman Intelligent Robotics Research Centre (IRRC) Department of Electrical.

Data and Applications Security Developments and Directions Dr. Bhavani Thuraisingham The University of Texas at Dallas Lecture #15 Secure Multimedia Data.

Implementation, Comparison and Literature Review of Spatio-temporal and Compressed domains Object detection. By Gokul Krishna Srinivasan Submitted to Dr.

DETECTING AND TRACKING TRACTOR-TRAILERS USING VIEW-BASED TEMPLATES Masters Thesis Defense by Vinay Gidla Apr 19,2010.

Semantic Extraction and Semantics-Based Annotation and Retrieval for Video Databases Authors: Yan Liu & Fei Li Department of Computer Science Columbia.

Digital Video Library Network Supervisor: Prof. Michael Lyu Student: Ma Chak Kei, Jacky.

Week 10 Emily Hand UNR.

An ANN Approach to Identify if Driver is Wearing Safety Belts Hanwen Chen 12/9/2013.

1 CS 430 / INFO 430 Information Retrieval Lecture 17 Metadata 4.

Duc-Tien Dang-Nguyen, Giulia Boato, Alessandro Moschitti, Francesco G.B. De Natale Department to Information and Computer Science –University of Trento.

3D Motion Data Mining Multimedia Project Multimedia and Network Lab, Department of Computer Science.

Erik Jonsson School of Engineering and Computer Science The University of Texas at Dallas Cyber Security Research on Engineering Solutions Dr. Bhavani.

MULTIMEDIA DATA MODELS AND AUTHORING

Motion Detection Frame 1Frame 2 Anomalous activity.

Preliminary Transformations Presented By: -Mona Saudagar Under Guidance of: - Prof. S. V. Jain Multi Oriented Text Recognition In Digital Images.

Data Mining in Germany IIM Conference, Oct. 24, 2012 Gottfried Schwarz, DLR > Lecture > Author Document > Datewww.DLR.de Chart 1.

MULTIMEDIA SYSTEMS CBIR & CBVR. Schedule Image Annotation (CBIR) Image Annotation (CBIR) Video Annotation (CBVR) Video Annotation (CBVR) Few Project Ideas.

Digital Video Library - Jacky Ma.

Visual Information Retrieval

Detecting Semantic Concepts In Consumer Videos Using Audio Junwei Liang, Qin Jin, Xixi He, Gang Yang, Jieping Xu, Xirong Li Multimedia Computing Lab,

3D Motion Classification Partial Image Retrieval and Download

Data and Applications Security Developments and Directions

CS201 Lecture 02 Computer Vision: Image Formation and Basic Techniques

Gender Classification Using Scaled Conjugate Gradient Back Propagation

Announcements Homework 5 due tonight (11:59pm) via Carmen Homework 6 out now: Due 11:59pm.

Part-Based Room Categorization for Household Service Robots

Introductory Seminar on Research: Fall 2017

Tracking parameter optimization

Video-based human motion recognition using 3D mocap data

Project Implementation for ITCS4122

Basic Intro Tutorial on Machine Learning and Data Mining

הפקולטה להנדסת חשמל - המעבדה לבקרה ורובוטיקה גילוי תנועה ועקיבה אחר מספר מטרות מתמרנות הטכניון - מכון טכנולוגי לישראל TECHNION.

Plankton Classification VIDI: Sign Recognition HANDWRITING RECOGNITION

Ying Dai Faculty of software and information science,

CNN-based Action Recognition Using Adaptive Multiscale Depth Motion Maps And Stable Joint Distance Maps Junyou He, Hailun Xia, Chunyan Feng, Yunfei Chu.

Research Institute for Future Media Computing

Presentation transcript:

3D Motion Classification Partial Image Retrieval and Download Multimedia Project Multimedia and Network Lab, Department of Computer Science

Sensors and 3D motion capture system 6/11/2016UTD Multimedia and Networking Lab2 Accelerometer Electromyogram Electrocardiogram

3D Motion Capture 3UTD Multimedia and Networking Lab6/11/2016

Integration  Analysis  Gait Analysis  Motion correlation and error modeling  Humanoid robotics  Game Control  Disease diagnostic  Motion Classification  Clustering 4UTD Multimedia and Networking Lab6/11/2016

3D Input Data (MoCap & EMG) 3D Mocap data M x 54 Matrix ( M is the total num of Frames ) 5UTD Multimedia and Networking Lab6/11/2016 EMG data

Input Data Format  Each Motion is represented by set of joint vectors  Use sliding Windows for feature extractions TibiaFootToe Windows (Time Frame) 6UTD Multimedia and Networking Lab6/11/2016

Image data 6/11/2016UTD Multimedia and Networking Lab7

Data Analysis 8 Motion capture Data Collection Preprocessing Feature Extraction Data Analysis Gait Cycle Cross-Pair 24 Feature Point Geometric Trans.

Project I: Object Semantics in Image Project II: Image Downloader Project III: 3D image Classification 6/11/2016UTD Multimedia and Networking Lab9

Project: Object Semantics in Image  Template-match based object semantics  Template-match 6/11/2016UTD Multimedia and Networking Lab10 + =

6/11/2016UTD Multimedia and Networking Lab11 Image template Input Image Visual image semantic SURF(Speeded Up Robust Features) SIFT(Scale-invariant feature transfrom) HOG(Histogram of Gradients) ….

Project Goal  Goal: Building Visual Image Semantics using template-match based approach.  Input: Image data(2D)  Training Data : Partial Image data(2D)  Output: related Spatial data(2D, Visual Image Semantics)  Requirement:  Language option: anything 12UTD Multimedia and Networking Lab6/11/2016

Project: Annotated Image based Image (and Video) Downloader  DB- Flickr, Goolge Image… 6/11/2016UTD Multimedia and Networking Lab13

MIT Labelme project (Image tagging)  6/11/2016UTD Multimedia and Networking Lab14

6/11/2016UTD Multimedia and Networking Lab15 Image Tagging (Annotation) Query Image google Flickr Word based image search Download images

Project Goal (II)  Goal: Building Content based Image Downloader  Input: Image data(2D)  Training Data : Labelme Image DB  Output: collections of related Spatial data(2D)  Requirement:  Language option: anything  Lableme matlab toolbox: 16UTD Multimedia and Networking Lab6/11/2016

Project: 3D motion classification using Mocap data template  Mocap clustering and detection 6/11/2016UTD Multimedia and Networking Lab17 Mocap based motion template 3D image (image sequence) Object tracking Classification

Project Goal  Goal: Cluster each motion using any machine leaning techniques to form a set of motions to decide 3D image motion set.  Window size: 360 frames with 108 frames overlapping  Input: Image Sequence data(3D)  Training Data : Mocap data (54D)  Output: Segmented image sequence data(3D)  Requirement:  Language option: anything 6/11/2016UTD Multimedia and Networking Lab18

Question? Duk-Jin Thank You ! 19UTD Multimedia and Networking Lab6/11/2016