Motion Capture The process of recording movement and translating that movement onto a digital model Games Fast Animation Movies Bio Medical Analysis VR

Types of Tracking Facial tracking Full body tracking Hand tracking Partial body tracking

1- Mechanical Motion Capture Using an exoskeleton Each joint is connected to an angular encoder The value of movement of each encoder is recorded by a computer Pros: Not being influenced by external factors Cons: Freedom of movement is limited Absolute positions are not known

2- Magnetic Motion Capture Magnetic sensors and a magnetic field generator Detect sensor position based on field strength Pros: Data captured is accurate Cons: External disruptions by electrical/magnetic fields by other devices

3- Optical Motion Capture Using Markers (Reflective or Emitting) Uses light intensity to determine marker position Pros: Free movement Very clean and detailed data(?????) Cons: Reflective dots can be blocked, causing loss of data Rotations of body parts are not absolute and must be solved for(????)

4- Marker less Tracking Using computer vision Detect Humans in the picture Uses techniques to extract motion information from the image Silhouette detection Joint detection

Market Survey

PhaseSpace 4:24 Impulse cams 20:100 impulse active LED Price:$29, to $123, feature: full body motion tracking (including fingers using gloves)

Nintendo Wii Accelerometer, Optical sensors Gaming System Price:$199 Limitations: Can only track the motion of the hand Only useable with the Wii

Sony PS3 Eye Web Cam price: cam:$34.99, playstation 3:$ feature: recognizes hand and body movements Limitations: Officially Works only with Sony PS3 Low resolution 640x480

The Virtual Me Approach A frame work for Human motion capture Color based markers Arbitrary number of cams Detect major limbs motion and orientation Hopefully real time

Sample application A simple game will be used as a demonstration Virtual Goal The player will defend his goal from multiple footballs

System Design

Image Processing Pipelines IPP(1 ) IPP(2 ) IPP( K) Marker Detector Merging Module Constraint module History Body Constructor Camera Interface Capture

Capture rate Adjustment

Time Plan (Plan carefully)

Time Plan 2

Development Language C++ Tools Visual Studio 2008 Open CV 2.0

Questions