2. Motion Capture The process of recording movement and translating that movement onto a digital model Games Fast Animation Movies Bio Medical Analysis VR

3. Types of Tracking Facial tracking Full body tracking Hand tracking Partial body tracking

4. 1- Mechanical Motion Capture Using an exoskeleton Each joint is connected to an angular encoder The value of movement of each encoder is recorded by a computer Pros: Not being influenced by external factors Cons: Freedom of movement is limited Absolute positions are not known

5. 2- Magnetic Motion Capture Magnetic sensors and a magnetic field generator Detect sensor position based on field strength Pros: Data captured is accurate Cons: External disruptions by electrical/magnetic fields by other devices

6. 3- Optical Motion Capture Using Markers (Reflective or Emitting) Uses light intensity to determine marker position Pros: Free movement Very clean and detailed data(?????) Cons: Reflective dots can be blocked, causing loss of data Rotations of body parts are not absolute and must be solved for(????)

7. 4- Marker less Tracking Using computer vision Detect Humans in the picture Uses techniques to extract motion information from the image Silhouette detection Joint detection

8. Market Survey

9. PhaseSpace 4:24 Impulse cams 20:100 impulse active LED Price:$29,950.00 to $123,950.00 feature: full body motion tracking (including fingers using gloves)

10. Nintendo Wii Accelerometer, Optical sensors Gaming System Price:$199 Limitations: Can only track the motion of the hand Only useable with the Wii

11. Sony PS3 Eye Web Cam price: cam:$34.99, playstation 3:$299.00 feature: recognizes hand and body movements Limitations: Officially Works only with Sony PS3 Low resolution 640x480

12. The Virtual Me Approach A frame work for Human motion capture Color based markers Arbitrary number of cams Detect major limbs motion and orientation Hopefully real time

13. Sample application A simple game will be used as a demonstration Virtual Goal The player will defend his goal from multiple footballs

14. System Design

15. Image Processing Pipelines IPP(1 ) IPP(2 ) IPP( K) Marker Detector Merging Module Constraint module History Body Constructor Camera Interface Capture

16. Capture rate Adjustment

17. Time Plan (Plan carefully)

18. Time Plan 2

19. Development Language C++ Tools Visual Studio 2008 Open CV 2.0

20. Questions