Motion Capture Animation

Slides:



Advertisements
Similar presentations
CS 6353 Computer Graphics and Multimedia
Advertisements

Virtual Me. Motion Capture The process of recording movement and translating that movement onto a digital model Originally used for military tracking.
Virtual Me. Motion Capture (mocap) Motion capture is the process of simulating actual movement in a computer generated environment The capture subject.
MOTION CAPTURE IN LIFE SCIENCES Mario Lamontagne.
Computer Graphics Computer Animation& lighting Faculty of Physical and Basic Education Computer Science Dep Lecturer: 16 Azhee W. MD.
Dr. Midori Kitagawa University of Texas at Dallas Arts and Technology Program.
Quiz 3, Go to Please list the author and.
1cs533d-winter-2005 Computer Animation Robert Bridson (preview of CPSC 426)
Motion Capture CS294-7 Jacqueline Takeshita Mindy Lue.
Advanced Computer Graphics (Fall 2010) CS 283, Lecture 24: Motion Capture Ravi Ramamoorthi Most slides courtesy.
© , The Ohio State University Motion Capture History, Pipeline, and Areas of Interest Advanced Computing Center for the Arts and Design Ohio State.
Key Frame Animation Amy Gooch AA3: Intro to Animation.
Lecture 4: Motion Capture Jinxiang Chai. Outline Mocap history Mocap technologies Mocap pipeline Mocap Data Mocap Challenges.
Bleep’s Escape Motion Capture Production – Sp 04 The RED Group Sean Chang, Shawn Hove, Josh Huber, Ambrish Tyagi.
8/16/99 Experiments in Motion (Capture). 8/16/99 Experiments in Motion Capture Project Course Week 3-5: Motion Capture Pipeline Assignments Then start.
Introduction to 3D Beginner: the class Instructor : Hee Holmen.
CSCE 641: Computer Graphics Image-based Rendering Jinxiang Chai.
Motion Capture in 3D Animation Animation : Movies Animation : Movies Video Games Video Games Robot Control Robot Control.
Animation Theory.
Computer Animation CS 445/645 Fall Let’s talk about computer animation Must generate 30 frames per second of animation (24 fps for film) Issues.
Optical Motion Capture Bobby Bruckart Ben Heipp James Martin Molly Shelestak.
Animation is mainly used to produce cartoons, however, it is also used to produce special effects in commercials, live-action movies, video games, and.
RIGS & MOTION CAPTURE By: Jennifer Marcial and Juan m. lopez A presentation on animation film-making, and how it works.
Algirdas Beinaravičius Gediminas Mazrimas.  Introduction  Motion capture and motion data  Used techniques  Animating human body  Problems.
History of Motion Capture Dr. Midori Kitagawa Arts and Technology Program University of Texas at Dallas.
Algirdas Beinaravičius Gediminas Mazrimas.  Introduction  Motion capture and motion data  Used techniques  Animating human body  Problems  Conclusion.
Motion Capture Laboratory School of Arts and Humanities Erik Jonsson School of Engineering and Computer Science University of Texas at Dallas.
Advanced Programming for 3D Applications CE Bob Hobbs Staffordshire university Motion Capture Lecture 2 Week 3.
Motion Capture: Hardware & Workflow Rama Hoetzlein, 2011 Lecture Notes Aalborg University at Copenhagen.
Motion Capture CSE 3541 Matt Boggus.
Computer Animation Prepared by Khadija Kuhail Supervised by Dr Sanaa Alsayegh.
Computer Animation Rick Parent Computer Animation Algorithms and Techniques Motion Capture.
UFCFY5-30-1Multimedia Studio 3D Modelling & Animation.
Pre Production I.Concept II.Story Development III.Visual Development IV.Technical Direction V.Production Management.
Television Production Team. Standard 7.0 Standard Text: Exhibit knowledge of the television production team. Learning Goal: Students will be able to understand.
Computer Animation Thesis “brief” Vic, CS 288, 10/22/98.
Integration Of CG & Live-Action For Cinematic Visual Effects by Amarnath Director, Octopus Media School.
Motion Capture Hardware
1 Lecture 19: Motion Capture. 2 Techniques Morphing Motion Capture.
3 Aspects of Film Literary Elements Dramatic Elements
Motion Capture. Animation – A broad Brush Traditional Methods  Cartoons, stop motion Keyframing  Digital inbetweens Motion Capture  What you record.
3D COMPUTER GRAPHICS IMD Chapter 1: 3D Computer Graphics Chapter 1: 1 Lecturer: Norhayati Mohd Amin.
Computer Graphics 2 In the name of God. Outline Introduction Animation The most important senior groups Animation techniques Summary Walking, running,…examples.
3D Animation 5. Character Animation Dr. Ashraf Y. Maghari Information Technology Islamic University of Gaza Ref. Book: The Art of Maya.
Motion Capture Animation & Procedural Animation
Computing & Information Sciences Kansas State University Lecture 15 of 42CIS 636/736: (Introduction to) Computer Graphics Lecture 15 of 42 William H. Hsu.
Multimedia Animation. Animation Principles Persistence of vision object seen by human eye remains mapped on retina for a brief time after viewing display.
“ Animation Through the Ages” Camelia McCallion. Main tasks What is computer animation? Hand drawn (cel) Flick books Animated cartoon Animation process.
ATEC Procedural Animation
Rick Parent - CIS681 Motion Capture Use digitized motion to animate a character.
DIGITAL CONTENT CREATION PROCESS fff PRE-PRODUCTION PRODUCTION POST-PRODUCTION Process ANIMATION PROCESS.
-BY SAMPATH SAGAR( ) ABHISHEK ANAND( )
Chapter 6.7 Animation. 2 Overview When to use animation Feedback to player about interaction with UI and in-game action Communicating environmental* conditions.
Feature Film Production Using 3D Computer Animation.
SS5305 – Popular Marker Setups 1. Objectives Marker Data Measurement Sequence Project Automation Framework (PAF) Popular marker setups PAF Interface 2.
Animation Animation is about bringing things to life Technically: –Generate a sequence of images that, when played one after the other, make things move.
Basic Theory of Motion Capture By: Vincent Verner.
Fundamentals of Computer Animation Motion Synthesis.
3D Animation 1. Introduction Dr. Ashraf Y. Maghari Information Technology Islamic University of Gaza Ref. Book: The Art of Maya.
Computer Animation Rick Parent Computer Animation Algorithms and Techniques Motion Capture.
Motion Capture CSE 3541 Matt Boggus.
Chapter 6.7 Animation.
Chapter 6.7 Animation.
3D Modelling & Animation
Procedural Animation Introduction to Procedural Methods in 3D Computer Animation Dr. Midori Kitagawa.
NWC601COM – 3D Modelling and Animation
NWC601COM – 3D Modelling and Animation
Assist. Lecturer Safeen H. Rasool Faculty of SCIENCE IT Dept.
Computer Graphics Lecture 15.
ATEC Procedural Animation
Presentation transcript:

Motion Capture Animation Dr. Midori Kitagawa Arts and Technology Program University of Texas at Dallas Gif animations by Dax Norman

What is Mocap? Motion capture (mocap) is sampling and recording motion of humans, animals, and inanimate objects as 3D data. The data can be used to study motion or to give an illusion of life to 3D computer models.

Applications Entertainment Medicine / Sports Arts / Education Science / Engineering

Entertainment: Live Action Films

Entertainment: 3D computer animations

Entertainment: Video Games

Medicine / Sports Medicine (e.g., gait analysis, rehabilitation) Sports (e.g. injury prevention, performance analyses, performance enhancement)

Arts / Education Dance and theatrical performances Archiving (e.g., Marcel Marceau) OSU/ACCAD

Science / Engineering Engineering (e.g., biped robot developments) Computer Science (e.g., human motion database, indexing, recognitions) Design (e.g., ergonomic product design) Military (e.g., field exercises, virtual instructors, and role-playing games)

Mocap animation Motion capture animation is different from keyframe animation in terms of how motion is created. Same principles of animations apply to mocap animation & keyframe animation! Combination of motion capture animation and keyframe animation is often used.

Keyframe animation Keyframe is a drawing of a key moment in an animated sequence, where the motion is at its extreme. Inbetweens fill the gaps between keyframes. Every motion is created by animators.

Advantages of mocap animation Faster to create (only if an established production pipeline exists.) Secondary motions and all the subtle motions are captured. -> more realism Physical interactions between performers and props can be captured.

Disadvantages of mocap animation Cost. Manipulating mocap data is often difficult -> Re-capturing or key framing a shot with bad data is often easier. Mapping mocap data of a performer to a 3D character with a different proportion may cause issues.

Popular types of mocap equipment Magnetic systems Mechanical systems Optical systems

Magnetic systems Utilize sensors placed on the body to measure the magnetic field generated by a transmitter source.

Magnetic systems  Require no special lighting condition.  Sensors are never occluded. X Affected by electromagnetic force.

Mechanical systems Exoskeleton with angle sensors.

Mechanical systems  Measure joint angles (no marker ID problems).  Sensors are never occluded. X Breakable! X Configuration of sensors is fixed. X Constrains on joints.

Optical systems The cameras are equipped with infrared LED's and filters. The cameras see reflector markers.

Optical systems  Higher sampling rate.  Larger capture space. X Markers are sometimes occluded -> marker ID problems. X Provide only positional data -> joint angles need to be computed.

Mocap system at UTD Vicon optical system 8 high-speed MX 13 (up to 10,000 fps) and 8 high-resolution MX 40 (4 megapixels) cameras. Capture up to 5 performers at once.

Mocap animation courses Graduate level: ATEC 6352 & UG level: ATEC 4345 Group project based Group of 3 to 5 members Semester long project Pre-requisite: ATEC 3317 Modeling and texturing OR ATEC 3327 Lighting and composition Recommended: ATEC 3328 Rigging I ATEC 4337 Computer Animation

Mocap animation pipeline Preproduction Capture -> data cleaning -> retargeting Modeling -> rigging ----------------------------- mocap animation Keyframe animation Effect animation Sound design Texturing/lighting -> Rendering -> Composition Post-production * Tasks that everyone should be involved. * Tasks that can be designated to a member or members.

FBX VSK MOTION BUILDER FBX FBX MB BLADE Mocap Pipeline Flow Chart MAYA 2D Image -> 2D Camera Data -> 3D Markers Positions -> Trajectories -> Recon Skeleton -> Solver Skeleton System Calibration and Capturing and Processing Data FBX Circle fitting Triangulation Reconstruction Skeleton with subject’s size & proportion and motion data BLADE Subject Calibration VSK VST (subject template) MOTION BUILDER Capture Range of Motion (ROM) Reconstruct trajectories of ROM Label markers Skeleton with subject’s size & proportion Mocap Pipeline Flow Chart The processes that you go through for each character Character Setup Correlate : Character & (FBX) Edit motion Bake motion data to the skeleton FBX Character Setup Create a skeleton Bind skin to the skeleton Rig the character Skeleton with 3D character’s size & proportion (and skin) MAYA The processes that you repeat for each shot Rendering FBX Marge the rigged character (MB) and the skeleton with motion data (FBX) Edit motion (IK/FK blend, Trax) Render MB Skeleton with motion data & 3D character’s size & proportion Maya Scene File

Dr. Midori Kitagawa midori@utdallas.edu ATEC 1.909