HCI / CprE / ComS 575: Computational Perception Instructor: Alexander Stoytchev

Slides:



Advertisements
Similar presentations
Bayesian Decision Theory Case Studies
Advertisements

OpenCV Introduction Hang Xiao Oct 26, History  1999 Jan : lanched by Intel, real time machine vision library for UI, optimized code for intel 
Actions in video Monday, April 25 Kristen Grauman UT-Austin.
Xin Zhang, Zhichao Ye, Lianwen Jin, Ziyong Feng, and Shaojie Xu
A KLT-Based Approach for Occlusion Handling in Human Tracking Chenyuan Zhang, Jiu Xu, Axel Beaugendre and Satoshi Goto 2012 Picture Coding Symposium.
Proceedings of the British Machine Vision Conference (BMVC), 2010 Qi Wang, Xilin Chen, Wen Gao Skin Color Weighted Disparity Competition for Hand Segmentation.
SOMM: Self Organizing Markov Map for Gesture Recognition Pattern Recognition 2010 Spring Seung-Hyun Lee G. Caridakis et al., Pattern Recognition, Vol.
COMP322/S2000/L181 Pre-processing: Smooth a Binary Image After binarization of a grey level image, the resulting binary image may have zero’s (white) and.
Recent Developments in Human Motion Analysis
Master’s Project Proposal Briefing Bill Champlin Java Quasi-Connected Components (JQCC) Tracking System March 10, 2009 Advisor - Dr. Terrance Boult.
OpenCV Stacy O’Malley CS-590 Summer, What is OpenCV? Open source library of functions relating to computer vision. Cross-platform (Linux, OS X,
City College of New York 1 John (Jizhong) Xiao Department of Electrical Engineering City College of New York Projects for Advanced.
Computer Vision for Interactive Computer Graphics Mrudang Rawal.
CS335 Principles of Multimedia Systems Multimedia and Human Computer Interfaces Hao Jiang Computer Science Department Boston College Nov. 20, 2007.
The Recognition of Human Movement Using Temporal Templates Liat Koren.
Viewpoint Tracking for 3D Display Systems A look at the system proposed by Yusuf Bediz, Gözde Bozdağı Akar.
Machine Learning Damon Waring 22 April of 15 Agenda Problem, Solution, Benefits Problem, Solution, Benefits Machine Learning Overview/Basics Machine.
A Fast and Robust Fingertips Tracking Algorithm for Vision-Based Multi-touch Interaction Qunqun Xie, Guoyuan Liang, Cheng Tang, and Xinyu Wu th.
Flow Based Action Recognition Papers to discuss: The Representation and Recognition of Action Using Temporal Templates (Bobbick & Davis 2001) Recognizing.
HCI/ComS 575X: Computational Perception Instructor: Alexander Stoytchev
ELECTRONIC CONDUCTING SYSTEM Kenzo Abrahams Supervisor: Mehrdad Ghaziasgar Co-supervisor: James Connan Assisted by: Diego Mushfieldt.
Robust Hand Tracking with Refined CAMShift Based on Combination of Depth and Image Features Wenhuan Cui, Wenmin Wang, and Hong Liu International Conference.
Multimedia Specification Design and Production 2013 / Semester 2 / week 8 Lecturer: Dr. Nikos Gazepidis
1 Mean shift and feature selection ECE 738 course project Zhaozheng Yin Spring 2005 Note: Figures and ideas are copyrighted by original authors.
HCI / CprE / ComS 575: Computational Perception
CIS 601 Fall 2003 Introduction to Computer Vision Longin Jan Latecki Based on the lectures of Rolf Lakaemper and David Young.
Project title : Automated Detection of Sign Language Patterns Faculty: Sudeep Sarkar, Barbara Loeding, Students: Sunita Nayak, Alan Yang Department of.
Portable Vision-Based HCI A Real-Time Hand Mouse System on Portable Devices 連矩鋒 (Burt C.F. Lien) Department of Computer Science and Information Engineering.
HCI/ComS 575X: Computational Perception Instructor: Alexander Stoytchev
CS 4630: Intelligent Robotics and Perception Case Study: Motor Schema-based Design Chapter 5 Tucker Balch.
1 Webcam Mouse Using Face and Eye Tracking in Various Illumination Environments Yuan-Pin Lin et al. Proceedings of the 2005 IEEE Y.S. Lee.
Research Activities at Florida State Vision Group Xiuwen Liu Florida State Vision Group Department of Computer Science Florida State University
Vision-based human motion analysis: An overview Computer Vision and Image Understanding(2007)
MSRI workshop, January 2005 Object Recognition Collected databases of objects on uniform background (no occlusions, no clutter) Mostly focus on viewpoint.
Model of the Human  Name Stan  Emotion Happy  Command Watch me  Face Location (x,y,z) = (122, 34, 205)  Hand Locations (x,y,z) = (85, -10, 175) (x,y,z)
Lecture 7: Features Part 2 CS4670/5670: Computer Vision Noah Snavely.
A study on face system Speaker: Mine-Quan Jing National Chiao Tung University.
Curiosity-Driven Exploration with Planning Trajectories Tyler Streeter PhD Student, Human Computer Interaction Iowa State University
Expectation-Maximization (EM) Case Studies
Students: Meera & Si Mentor: Afshin Dehghan WEEK 4: DEEP TRACKING.
HCI/ComS 575X: Computational Perception Instructor: Alexander Stoytchev
Fingertip Detection with Morphology and Geometric Calculation Dung Duc Nguyen ; Thien Cong Pham ; Jae Wook Jeon Intelligent Robots and Systems, IEEE/RSJ.
Sean M. Ficht.  Problem Definition  Previous Work  Methods & Theory  Results.
HCI / CprE / ComS 575: Computational Perception Instructor: Alexander Stoytchev
HCI/ComS 575X: Computational Perception Instructor: Alexander Stoytchev
Virtual Image Peephole By Kyle Patience Supervisor: Reg Dodds Co Supervisor: Mehrdad Ghaziasgar.
Face Detection Using Neural Network By Kamaljeet Verma ( ) Akshay Ukey ( )
Application of Stereo Vision in Tracking *This research is supported by NSF Grant No. CNS Opinions, findings, conclusions, or recommendations.
Vision Based hand tracking for Interaction The 7th International Conference on Applications and Principles of Information Science (APIS2008) Dept. of Visual.
What is Multimedia Anyway? David Millard and Paul Lewis.
Over the recent years, computer vision has started to play a significant role in the Human Computer Interaction (HCI). With efficient object tracking.
Bayesian Decision Theory Case Studies CS479/679 Pattern Recognition Dr. George Bebis.
Day 3: computer vision.
CS201 Lecture 02 Computer Vision: Image Formation and Basic Techniques
HCI / CprE / ComS 575: Computational Perception
Instructor: Alexander Stoytchev
HCI/ComS 575X: Computational Perception
Video-based human motion recognition using 3D mocap data
CSSE463: Image Recognition Day 25
Outline S. C. Zhu, X. Liu, and Y. Wu, “Exploring Texture Ensembles by Efficient Markov Chain Monte Carlo”, IEEE Transactions On Pattern Analysis And Machine.
HCI / CprE / ComS 575: Computational Perception
HCI/ComS 575X: Computational Perception
HCI/ComS 575X: Computational Perception
HCI/ComS 575X: Computational Perception
HCI/ComS 575X: Computational Perception
HCI/ComS 575X: Computational Perception
HCI/ComS 575X: Computational Perception
HCI/ComS 575X: Computational Perception
Image Processing and Multi-domain Translation
HCI/ComS 575X: Computational Perception
Presentation transcript:

HCI / CprE / ComS 575: Computational Perception Instructor: Alexander Stoytchev

Next Time Project ideas. Brief 3-5 min presentations.

Administrative Stuff The Wiki is now configured. Please register and create your page. HW2 template is no posted.

Skin Color Detection HCI/ComS 575X: Computational Perception Iowa State University Copyright © Alexander Stoytchev

“Skin-color modeling and adaptation” Yang, Lu, and Waibel CMU-CS , May 1997 (Available on the Class Web page) [Readings Section]

3D Scatter Plot for a patch of skin

Detecting Human Skin

Example [

Another Example [

A Different Color Space

Properties

Color Histogram

Matlab Demo of Skin Detection (see code on the class web page)

Motion Energy & Motion History HCI/ComS 575X: Computational Perception Iowa State University Copyright © Alexander Stoytchev

A.F. Bobick and J.W. Davis ``An appearance-based representation of action''. In Proceedings of IEEE International Conference on Pattern Recognition 1996, August 1996, pp

A.Davis, J. and A. Bobick ``The Representation and Recognition of Action Using Temporal Templates'', In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, June 1997, pp

A.F. Bobick and J.W. Davis ``An appearance-based representation of action''. In Proceedings of IEEE International Conference on Pattern Recognition 1996, August 1996, pp

A.Davis, J. and A. Bobick ``The Representation and Recognition of Action Using Temporal Templates'', In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, June 1997, pp

The Authors James Davis Aaron Bobick

What is this?

What action is being performed?

Motion Energy Image (MEI) [

Average MEI for various viewing angles

Motion History Image (MHI) [

Definitions Image Sequence Binary Images indicating regions of motion Binary Motion Energy Image

Motion Energy

Motion History The result: more recently moving pixels appear brighter

[

MHI pyramid [

Motion templates for finishing LEFT-ARM-RAISE and FAN-UP-ARMS. [

Aerobics Dataset

Results for 30 o off center camera location

OpenCV Demo If you want to try this at home just compile and run the motempl.c file in the../samples/c directory

Applications

A.Bobick, S. Intille, J. Davis, F. Baird, C. Pinhanez, L. Campbell, Y. Ivanov, A. Schutte, and A. Wilson (1999) ``The Kidsroom: A Perceptually- Based Interactive and Immersive Story Environment" Presence: Teleoperators and Virtual Environments, Vol. 8, No. 4, 1999, pp

The Kid’s Room [Bobick et al. 1996]

The Kid’s Room [

The Kid’s Room [

The Kid’s Room [

Monsters [

Scavenger Hunt [

Scavenger Hunt [

The Blue Monster [

Spin in place [

3 Kids Spin on a Rug [

The River Vorls [

The Technology [

Motion History Templates Making a ‘Y’ FlappingSpinning [

Detecting the Bed [

Man Overboard Detector [

Movies The quality of the movies is not very good You can download them from: demos/kidsroom/kidsroom.html

J. Davis and A. Bobick ``Virtual PAT: A Virtual Personal Aerobics Trainer'', Workshop on Perceptual User Interfaces, November 1998, pp

Interactive Virtual Aerobics Trainer [

Interactive Virtual Aerobics Trainer [

Interactive Virtual Aerobics Trainer [

Movies

The Personal Pet Project Pepe Joint work with Rawesak Tanawongsuwan

Tanawongsuwan, R., Stoytchev, A., and Essa, I., "Robust Tracking of People by a Mobile Robotic Agent", Technical Report GIT-GVU

Project Goals build an intelligent, adaptive, user-friendly agent build an agent that has a personality make the interaction between the user and the agent as natural as possible

Pointing gesture Motion Profile Calculation Face and Hands Segmentation Neural Network Hidden Markov Models Gesture Recognition

Motion History/Energy Perform a frame-by-frame subtraction (image differencing) and accumulate the results over the history window. Motion energy is a binary version of motion history Technique from Bobick and Davis.

Gesture recognition

Gesture Recognition

Gesture recognition

Movie

THE END