Motion Capture CSE 3541 Matt Boggus.

Slides:

Advertisements

Similar presentations

CS 6353 Computer Graphics and Multimedia

Advertisements

Team:. Prepared By: Menna Hamza Mohamed Mohamed Hesham Fadl Mona Abdel Mageed El-Koussy Yasmine Shaker Abdel Hameed Supervised By: Dr. Magda Fayek.

Virtual Me. Motion Capture Human Motion Capture Different Fields Goals.

Virtual Me. Motion Capture The process of recording movement and translating that movement onto a digital model Originally used for military tracking.

Motion Capture The process of recording movement and translating that movement onto a digital model Games Fast Animation Movies Bio Medical Analysis VR.

Virtual Me. Motion Capture (mocap) Motion capture is the process of simulating actual movement in a computer generated environment The capture subject.

Prepared By: Menna Hamza Mohamed Mohamed Hesham Fadl Mona Abdel Mageed El-Koussy Yasmine Shaker Abdel Hameed Supervised By: Dr. Magda Fayek.

MOTION CAPTURE IN LIFE SCIENCES Mario Lamontagne.

KINECT REHABILITATION

1cs533d-winter-2005 Computer Animation Robert Bridson (preview of CPSC 426)

Motion Capture CS294-7 Jacqueline Takeshita Mindy Lue.

Advanced Computer Graphics (Fall 2010) CS 283, Lecture 24: Motion Capture Ravi Ramamoorthi Most slides courtesy.

© , The Ohio State University Motion Capture History, Pipeline, and Areas of Interest Advanced Computing Center for the Arts and Design Ohio State.

May 10, 2004Facial Tracking and Animation Todd Belote Bryan Harris David Brown Brad Busse.

Plan for today Discuss your interests and possible term paper topics Discuss biomechanics websites Powerpoint presentation on kinematics and their measurement.

1cs426-winter-2008 Notes  Example final exam up in Work section of website Take with a grain of salt  Collision notes part 1 (primitive operations) up.

3D Measurements by PIV  PIV is 2D measurement 2 velocity components: out-of-plane velocity is lost; 2D plane: unable to get velocity in a 3D volume. 

Game Development with Kinect

Drawing a Skeleton Fast From Motion Capture Data Jonathan Kipling Knight Nov 7, 2006.

CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.

CSCE 641: Computer Graphics Image-based Rendering Jinxiang Chai.

Plan for today Discuss your assignments detailed on the last slide of the powerpoint for last week on: –Topics/problems in which you are most interested.

Motion Capture in 3D Animation Animation : Movies Animation : Movies Video Games Video Games Robot Control Robot Control.

Animation Theory.

Motion Capture Animation

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.

Motion Capture in 3D Animation Edward Tse. Motion Capture as a Tool Motion capture (MOCAP) is an effective 3D animation tool for realistically capturing.

Animation is mainly used to produce cartoons, however, it is also used to produce special effects in commercials, live-action movies, video games, and.

Motion Capture Laboratory School of Arts and Humanities Erik Jonsson School of Engineering and Computer Science University of Texas at Dallas.

Motion Capture: Hardware & Workflow Rama Hoetzlein, 2011 Lecture Notes Aalborg University at Copenhagen.

Computer Animation Rick Parent Computer Animation Algorithms and Techniques Motion Capture.

Page 1 | Microsoft Streams sync and coordinate mapping Kinect for Windows Video Courses.

Quick Overview of Robotics and Computer Vision. Computer Vision Agent Environment camera Light ?

1 Intelligent Robotics Research Centre (IRRC) Department of Electrical and Computer Systems Engineering Monash University, Australia Visual Perception.

Motion Capture Hardware

1 Lecture 19: Motion Capture. 2 Techniques Morphing Motion Capture.

Motion Capture. Animation – A broad Brush Traditional Methods  Cartoons, stop motion Keyframing  Digital inbetweens Motion Capture  What you record.

Prepared By: Menna Hamza Mohamed Mohamed Hesham Fadl Mona Abdel Mageed El-Koussy Yasmine Shaker Abdel Hameed Supervised By: Dr. Magda Fayek.

Page 1 | Microsoft Work With Skeleton Data Kinect for Windows Video Courses Jan 2013.

Page 1 | Microsoft Work With Color Data Kinect for Windows Video Courses Jan 2013.

SS5305 – Motion Capture Initialization 1. Objectives Camera Setup Data Capture using a Single Camera Data Capture using two Cameras Calibration Calibration.

Surface Computing Turning everyday surfaces into interactive intelligent interfaces Co-located input and output Mixed reality: tangible objects, natural.

Motion Capture Animation & Procedural Animation

PCB Soldering Inspection. Structured Highlight approach Structured Highlight method is applied to illuminating and imaging specular surfaces which yields.

Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing.

Rick Parent - CIS681 Motion Analysis – Human Figure Processing video to extract information of objects Motion tracking Pose reconstruction Motion and subject.

CONTENT 1. Introduction to Kinect 2. Some Libraries for Kinect 3. Implement 4. Conclusion & Future works 1.

Integration for physically based animation CSE 3541 Matt Boggus.

Tracking Systems in VR.

CS-378: Game Technology Lecture #15.5: Physically Based Simulation Prof. Okan Arikan University of Texas, Austin Thanks to James O’Brien, Steve Chenney,

Rick Parent - CIS681 Motion Capture Use digitized motion to animate a character.

Robotics/Machine Vision Robert Love, Venkat Jayaraman July 17, 2008 SSTP Seminar – Lecture 7.

-BY SAMPATH SAGAR( ) ABHISHEK ANAND( )

Basic Theory of Motion Capture By: Vincent Verner.

Fundamentals of Computer Animation Motion Synthesis.

Input Units Aj.Drusawin Vongpramate

Presented by 翁丞世  View Interpolation  Layered Depth Images  Light Fields and Lumigraphs  Environment Mattes  Video-Based.

Computer Animation Rick Parent Computer Animation Algorithms and Techniques Motion Capture.

Motion Capture CSE 3541 Matt Boggus.

Creative Coding & the New Kinect

AN OPEN BIOMECHANICS SYSTEM USING COMMODITY HARDWARE

Musical Instrument Virtual

CAPTURING OF MOVEMENT DURING MUSIC PERFORMANCE

Datalogging with video

Reflections & Rotations

Kinect for Creative Development with open source frameworks

Multiple View Geometry for Robotics

7.1 Rigid Motion in a Plane OBJECTIVES:

Computer Graphics Lecture 15.

3D User Interface Input Hardware

Presentation transcript:

Motion Capture CSE 3541 Matt Boggus

MoCap Technologies Instrument the talent to facilitate tracking feature points on the human figure Need some kind of sense-able markers from which positional and possibly rotational status can be recorded

“Traditional” MoCap Technologies Optical – uses video capture passive – markers just reflect light active – markers emit light Magnetic – active sensors sense their position and orientation in magnetic field Electro-Mechanical – rotors connected to limb-aligned rods record their status – for hands, optical sensors used sometimes

Optical - Passive

Optical - Active

Ex: Ascension technology http://www.ascension-tech.com/ Magnetic

Ex: Metamotion http://www.metamotion.com Electro-Mechanical

Newer MoCap Technologies Inertial systems (similar to Wii technology) Make-up (fluorescent powder) Semi-passive imperceptible markers (emit light and observe changes ; Kinect uses infrared) Markerless systems (video tracking)

Markerless Organic Motion www.organicmotion.com/ Image Metrics (facial) www.image-metrics.com/

Kinect – skeleton tracking, depth, audio Using the Kinect in Unity http://channel9.msdn.com/coding4fun/kinect/Unity-and-the-Kinect-SDK

Passive Optical

Motion capture lab Multiple markers - e.g., 20-40 Multiple cameras - e.g., 8-14 high-res, high-speed Constrained, conditioned space - 20x20 non-reflective Multiple lights - synced w/ cameras Vicon http://www.vicon.com/applications/animation.html

Motion capture lab

Processing the Images PROCESSING STEPS Extract markers from video Track markers over time in video Marker cleanup 3D marker position reconstruction Joint position reconstruction Joint angle reconstruction

Extract markers from video Basic image processing aided by constrained environment: High contrast markers Special illumination Non-reflective environment

Marker tracking Given frames each with recognized markers Associate markers over multiple frames Temporal coherence using: Position Frame rate Velocity

Marker Clean-up

3D – image plane projection Projecting marker onto image plane

Camera calibration Project known 3-space points to camera’s image Six degrees of freedom - use that many known point-pairs

Projecting from 2D image out to 3-space

Reconstructing a 3D marker

Fitting to the skeleton Locate joints relative to markers Markers Joint

Reconstructing angles

Working with Mocap Sample files http://accad.osu.edu/research/mocap/mocap_data.htm http://mocap.cs.cmu.edu/ https://sites.google.com/a/cgspeed.com/cgspeed/motion-capture http://www.turbosquid.com/ http://www.motioncapturedata.com/ Tools MotionBuilder Maya 3DSMax

Manipulating the mocap data Frequency deconstruction & manipulation Transitioning between two motions – Blending How to map a motion onto a figure with different geometry – Retargeting Finding motion clips to create behavior – motion graphs