©2003-2010, The Ohio State University Motion Capture History, Pipeline, and Areas of Interest Advanced Computing Center for the Arts and Design Ohio State.

Slides:

Advertisements

Similar presentations

CS 6353 Computer Graphics and Multimedia

Advertisements

Team:. Prepared By: Menna Hamza Mohamed Mohamed Hesham Fadl Mona Abdel Mageed El-Koussy Yasmine Shaker Abdel Hameed Supervised By: Dr. Magda Fayek.

Virtual Me. Motion Capture The process of recording movement and translating that movement onto a digital model Originally used for military tracking.

Motion Capture The process of recording movement and translating that movement onto a digital model Games Fast Animation Movies Bio Medical Analysis VR.

Virtual Me. Motion Capture (mocap) Motion capture is the process of simulating actual movement in a computer generated environment The capture subject.

MOTION CAPTURE IN LIFE SCIENCES Mario Lamontagne.

Computer Graphics Computer Animation& lighting Faculty of Physical and Basic Education Computer Science Dep Lecturer: 16 Azhee W. MD.

3/5/2002Phillip Saltzman Video Motion Capture Christoph Bregler Jitendra Malik UC Berkley 1997.

Motion Capture CS294-7 Jacqueline Takeshita Mindy Lue.

CSCE 441 Computer Graphics: Animation with Motion Capture

Business and Computing Deanery 3D Modelling Tools Week 13 Animation.

Lecture 4: Motion Capture Jinxiang Chai. Outline Mocap history Mocap technologies Mocap pipeline Mocap Data Mocap Challenges.

CSCE 641 Computer Graphics: Animation with Motion Capture Jinxiang Chai.

Rotoscope / Mocap: History

Tracking Gökhan Tekkaya Gürkan Vural Can Eroğul. Outline Tracking –Overview –Head Tracking –Eye Tracking –Finger/Hand Tracking Demos.

CSCE 641: Computer Graphics Image-based Rendering Jinxiang Chai.

CPSC 641 Computer Graphics: Animation with Motion Capture Jinxiang Chai.

Convergence of vision and graphics Jitendra Malik University of California at Berkeley Jitendra Malik University of California at Berkeley.

Rotoscoping Diane Ko Siyu Song November 5, Rotoscoping Animation of live-action film Images projected onto screen and redrawn Frame by frame reanimation.

Introduction to Motion (Capture). Syllabus (by the way: Mo-Cap = Motion Capture) 09-06/09-08:Intro / Demo 09-13/09-15:Squidball / History 09-20/09-22:Basics.

Motion Capture By: Ali Hosseini. Definition of Motion Capture Motion capture is the recording of human body movement (or other movement) for immediate.

Motion Capture in 3D Animation Animation : Movies Animation : Movies Video Games Video Games Robot Control Robot Control.

Animation Theory.

Motion Capture Animation

Motion Capture in 3D Animation Edward Tse. Motion Capture as a Tool Motion capture (MOCAP) is an effective 3D animation tool for realistically capturing.

Optical Motion Capture Bobby Bruckart Ben Heipp James Martin Molly Shelestak.

Animation is mainly used to produce cartoons, however, it is also used to produce special effects in commercials, live-action movies, video games, and.

RIGS & MOTION CAPTURE By: Jennifer Marcial and Juan m. lopez A presentation on animation film-making, and how it works.

History of Motion Capture Dr. Midori Kitagawa Arts and Technology Program University of Texas at Dallas.

Algirdas Beinaravičius Gediminas Mazrimas.  Introduction  Motion capture and motion data  Used techniques  Animating human body  Problems  Conclusion.

Motion Capture Laboratory School of Arts and Humanities Erik Jonsson School of Engineering and Computer Science University of Texas at Dallas.

The use of motion capture for computer character animation is relatively new, having begun in the late 1970's, and only now beginning to become wide spread.

Advanced Programming for 3D Applications CE Bob Hobbs Staffordshire university Motion Capture Lecture 2 Week 3.

SS5305 – Data Cleaning and Output 1. Objectives Skeletal Hierarchy Marker Data Position Re-targeting Data Cleaning Motion Reconstruction Data Output and.

Motion Capture CSE 3541 Matt Boggus.

Computer Animation Rick Parent Computer Animation Algorithms and Techniques Motion Capture.

   Input Devices Main Memory Backing Storage PROCESSOR

Smartphone Overview iPhone 4 By Anthony Poland 6 Nov 2014.

MIM 482 E SPRING TERM MIM 482 E SPRING TERM Prof. Dr. Orhan Hacıhasanoğlu Prof. Dr. Işıl Hacıhasanoğlu 13.

Motion Capture Hardware

1 Lecture 19: Motion Capture. 2 Techniques Morphing Motion Capture.

Sensors are mostly electronic devices used to monitor or capture something.

Motion Capture. Animation – A broad Brush Traditional Methods  Cartoons, stop motion Keyframing  Digital inbetweens Motion Capture  What you record.

Prepared By: Menna Hamza Mohamed Mohamed Hesham Fadl Mona Abdel Mageed El-Koussy Yasmine Shaker Abdel Hameed Supervised By: Dr. Magda Fayek.

3D COMPUTER GRAPHICS IMD Chapter 1: 3D Computer Graphics Chapter 1: 1 Lecturer: Norhayati Mohd Amin.

Motion Capture Animation & Procedural Animation

A General-Purpose Platform for 3-D Reconstruction from Sequence of Images Ahmed Eid, Sherif Rashad, and Aly Farag Computer Vision and Image Processing.

Algirdas Beinaravičius Gediminas Mazrimas.  Introduction  Motion capture and motion data  Used techniques  Animating human body  Problems  Conclusion.

Rotoscoping DAVID CHEN CS294-7 THE ART OF ANIMATION.

Business and Computing Deanery 3D Modelling Tools Week 13 Animation.

CS-378: Game Technology Lecture #13: Animation Prof. Okan Arikan University of Texas, Austin Thanks to James O’Brien, Steve Chenney, Zoran Popovic, Jessica.

Character Setup In addition to rigging for character models, rigging artists are also responsible for setting up animation controls for anything that is.

Rick Parent - CIS681 Motion Analysis – Human Figure Processing video to extract information of objects Motion tracking Pose reconstruction Motion and subject.

Subject Name: Computer Graphics Subject Code: Textbook: “Computer Graphics”, C Version By Hearn and Baker Credits: 6 1.

Rick Parent - CIS681 Motion Capture Use digitized motion to animate a character.

CGI/Motion Capture By Dominic Lauricella. CGI  CGI (Computer-generated imagery) is any sort of art created with computer graphics, rather than practical.

-BY SAMPATH SAGAR( ) ABHISHEK ANAND( )

Animation! The Horse in Motion (1878) by Eadweard Muybridge.

SS5305 – Popular Marker Setups 1. Objectives Marker Data Measurement Sequence Project Automation Framework (PAF) Popular marker setups PAF Interface 2.

Basic Theory of Motion Capture By: Vincent Verner.

Fundamentals of Computer Animation Motion Synthesis.

3D Animation 1. Introduction Dr. Ashraf Y. Maghari Information Technology Islamic University of Gaza Ref. Book: The Art of Maya.

Computer Animation Rick Parent Computer Animation Algorithms and Techniques Motion Capture.

3D Scanning Based on Computer Vision

Motion Capture CSE 3541 Matt Boggus.

CSCE 441 Computer Graphics: Animation with Motion Capture

CPSC 641 Computer Graphics: Animation with Motion Capture

Chapter 6.7 Animation.

CAPTURING OF MOVEMENT DURING MUSIC PERFORMANCE

Salevich Alex & Frenkel Eduard Wizard Hunting

Presentation transcript:

© , The Ohio State University Motion Capture History, Pipeline, and Areas of Interest Advanced Computing Center for the Arts and Design Ohio State University

©2010, The Ohio State University Motion Capture Motion capture (mocap) is sampling and recording motion of humans, animals and inanimate objects as 3d data for analysis, playback and remapping.

©2010, The Ohio State University History of Motion Capture Eadweard Muybridge ( ) Etienne-Jules Marey ( ) Harold Edgerton ( )

©2010, The Ohio State University Eadward Muybridge The Flying Horse Zoopraxiscope Animal and Human Locomotion © Kingston Museum

©2010, The Ohio State University Etienne-Jules Marey First person to analyze human and animal motion with video Created chronophotographic gun and fixed plate camera

©2010, The Ohio State University Harold Edgerton © Palm Press Inc.

©2010, The Ohio State University Rotoscope Allowed animators to trace cartoon characters over photographed frames of live performances. Invented in 1915 by Max Fleischer Koko the Clown Snow White

©2010, The Ohio State University 1980’s Military and medical research purposes First computer graphics use in research labs First production use o Brilliance by Robert Abel (1985 Superbowl ad) o associates/ associates/ o Waldo C. Graphic (1988) PDI for Jim Henson tour o Mike the Talking Head (Siggraph 88) o o Don’t Touch Me (1989) o

©2010, The Ohio State University Electromechanical Optical fiber Strobing LED Acoustic Optical Acoustic Motion Capture Systems

©2010, The Ohio State University Electromechanical suits Linked structures Potentiometers determine rotation of each link No occlusion No magnetic or electrical interference Large capture range, portable No global translation Restricted movement Fixed configuration of sensors Low sampling rate Inaccurate joints

©2010, The Ohio State University Optical fiber system Fiber-optic sensor Bend and twist sensors measure transmitted light No occlusion Multiple subjects Portable Adjustment to individual proportions is limited Less accurate data

©2010, The Ohio State University Electromagnetic systems Electromagnetic sensors placed on joints of moving object Measures orientation and position of sensor relative to electromagnetic field generated by transmitter No occlusion, multiple subjects Electromagnetic interference, small volume

©2010, The Ohio State University Acoustic system Set of microphones receive sound wave Other sounds in frequency range can disrupt capture Accuracy not as high as other systems

©2010, The Ohio State University Strobing LED marker system Fewer Occlusion Problems Limited volume

©2010, The Ohio State University Optical motion capture system Reflective markers Multiple cameras digitize different views of performance High speed capture High data accuracy Occlusion Position sensitive cameras Limited volume

Video-based Motion Analysis Research problem for 20+ years Difficulties o Complex varying environment o Segmentation issues o Occlusion ©2010, The Ohio State University

Video-based Motion Analysis Research Areas o Tracking o 3D surface reconstruction (surface scanning) o 3D movement reconstruction (video-based motion capture) o Recognition Challenges: o Complex environment variability o Body segmentation o Occlusion

©2010, The Ohio State University 3D Reconstruction Single camera o Model assumptions required Multiple cameras o Require at least 2 cameras, unique with 3 o Camera calibration Motion capture with markers o Use retroreflective markers to simplify video information

©2010, The Ohio State University Optical Mocap Process Calibration o Specifying how each camera is related to the others in reference to origin Tracking o Tracking of points…acceleration and identification problems Data o 3D positional…needs to be converted to rotational data

©2010, The Ohio State University Problems Related to Marker Occlusion

©2010, The Ohio State University Skeletal Fit (remapping mocap data to a character model) How to make markers move a skeleton o Photo reference of performer o CG model o Motion Builder o Vicon Blade o Other methods Problems with detecting joint centers… Organization of joint hierarchies

©2009, The Ohio State University Motion Capture Pipeline Planning Shooting (Vicon IQ) Data processing (ViconIQ, MotionBuilder) Skeleton creation (Maya) Mapping to characters (MotionBuilder) Binding skeleton to a model (Maya, MotionBuilder)

©2010, The Ohio State University Planning Character/Prop setup o Target skeleton/character topology o Ready stance considerations Marker setup o Heavy marker redundancy o Three markers per segment o Place markers close to bone

©2009, The Ohio State University Planning Shot list o Number of characters involved in performance o Performance space dimensions o Interactions in shot o Shots to be blended or looped o Length of shots o Size and location of props o Gross proportional differences for retargeting

©2009, The Ohio State University Planning Technical Issues o Output format o File naming conventions o Frames per second o Target software platform o Database management

©2010, The Ohio State University Other Areas of Interest Re-use of data Generating 3d geometry Scene tracking with motion capture

©2010, The Ohio State University New Optical Technology 16 megapixel cameras ( T-series Vicon and Motion Analysis), 2000 fps 10 bit greyscale – Vicon (better centroid calculation)

©2010, The Ohio State University Applications Medicine Mixed Reality Rehabilitation NIH Clinical Movement Analysis Lab Military Sports Video Games

©2010, The Ohio State University Other uses Cognitive Psychology Historical Preservation Art

©2009, The Ohio State University Feature Films Avatar Curious Case of Benjamin Button Pirates of the Carribean The Incredible Hulk Lord of the Rings Polar Express Matrix Titanic

©2009, The Ohio State University Video Games Kinect Move Wii

©2010, The Ohio State University Future Univesity of South California (Paul Debevec) NYU (Chris Briegler) Stanford University (Vlad Koltun) Carnegie Mellon (Jessica Hodgins) Max Planck Center Organic Motion Mova Image Metrics Captive Motion

©2010, The Ohio State University References 1.Menache, Alberto, “Understanding Motion Capture for Computer Animation and Video Games” Siggraph 2001 Course 51: