2. 2 IntroductionIndustries and AppsBioStageDiscussion Motion Capture Techniques Marker-based or wired Optical / Infrared Video-based Electromagnetic Electromechanical

3. The Human is the Marker 1. Video data streaming Multiple cameras capture the person from different angles 2. 3D Reconstruction Shape from silhouette algorithm creates three dimensional representation of the person 3.Character Fitting Human skeleton is then fit into 3D Model

4. 4 Digital You Real You Bones Texture Mesh Data 1. Collect Video The Human is the Marker 2. 3D Reconstruction 3. Mapping

5. 5 Software Markerless 3D Motion Tracking Tracks Humans and Objects Real-Time 3D data output (21 bones) Hybrid System Open, modular architecture Markerless Tracking

6. 6 Hardware Video cameras (FW B) 640 x 480 resolution (VGA) 30 - 200 fps Scalable scanning space Indoor, controlled environment Volume Calibration Record and save also videos Markerless Tracking

7. 7 IntroductionIndustries and AppsBioStageDiscussion 1.Entertainment  OpenStage V2.0 2.Life Sciences  BioStage V2.0 3.Training and Simulation 4.Public Installations Markets / Applications

8. 8 BioStage Model Tracking of 21 Segments Static user calibration Fully automatic or semi-automatic via calibration poses Landmarks directly measured or derived from separate measurements BioStage Model

9. 9 Live Demo – Vicomtech Spain - OM Admin Software Stick Figure and Voxel Figure Live Demo

10. 10 Data format and output 3D bone matrices and bone lengths SDK (C++) Plugins Innovative Sports Training - MotionMonitor (Biomechanics) Autodesk MotionBuilder (Animation) 3D mesh/texture internally available Data Output

11. 11 Integration – Animation CryEngine Unreal 3D Engine Virtools OpenStage Via SDK Motion Builder Via Plug-In XYZ 3D App 3DMaxMaya

12. 12 Integration – Life Science Kinetics Electro- myography Body- - Dimensions -Structure - Proportion Position, Angle, Velocity, etc. Forces, Moments, Pressure Distribution Muscle- action- potiential Data integration & Correlation Kinesiological Analysis  “Body”  “Motion”  “Forces”  “Neuromusc. Control” Anthro- pometry Kinematics BioStage

13. 13 TMM Motion Analysis Software BioStage Kinematics Force Plates Forces and Moments EMG Muscle Activity Video Via Plugin Integration – Life Science

14. 14 Live Demo – Vicomtech Spain - MotionBuilder and MotionMonitor - Show Avatar in MB and Skeleton in MM Live Demo

15. 15 Motion Tracking – In the Academics 1.Digital Media and related Game Development and Animation Training and Simulation Computer Science Theatre and Dance 2.Life Science and related Kinesiology Exercise Science Physical Therapy and Rehabilitation Health, Physical Education, and Recreation

16. 16 1.Motion Analysis ….. Diagnosis & Evaluation Tool Monitoring Tool Decision Making Tool 2.…… in Academics and Research Clinical Applications Sport Motion Analysis – Life Sciences

17. 17 1.Interactive GamesInteractive Games 2.Life Science, Training and Simulation http://www.youtube.com/user/OrganicMotion#p/c/3EF8710D28235BE0/7/txw5z69ZLfg 1.Digital World UF – Rehab on Soldiers with PTSDDigital World UF – Rehab on Soldiers with PTSD 2.World Builder GameWorld Builder Game 3.OpenStage 2.0OpenStage 2.0 4.Muscle ViewMuscle View 5.Ski Game http://www.youtube.com/watch?v=FZ9u5H6Ssow http://www.youtube.com/watch?v=FZ9u5H6Ssow Samples

18. 18 Steps during a typical Motion Capture session Calibration of capture area and/or subject Subject set-up Tracking of subject’s movement Clean-up/Post-processing of data Report generation Workflow Motion Capture

19. 19 Steps and time (approx.)with markerbased systems CalibrationSubject Setup Motion Tracking Post-ProcessingReport 5-30min15-45min5min 15-120min 5min 1min5min Calibration Motion Tracking Report Total: 11min Total: 45min – 195min Steps and time with OM Workflow How is OM different from others? Points of Difference

20. 20 FMT - evidenced-based functionally-oriented music therapy – Minea Bengsten Motion meets Music http://www.youtube.com/watch?v=sYRir9dHrps IDMAA – University of Florida, James Oliverio Projects - Music

21. 21 Therapist plays acoustic piano and clients are offered drums and cymbals to be played with specially designed drumsticks. Recorders and other wind instruments are also used for breathing development. By placing the instruments in certain predetermined positions the client is stimulated to act in collaboration with therapist and at the same time making use of his motor skills, all in all encouraging the progress of development. By changing the position of the instruments, varying posture between sitting and standing, the therapist also can stimulate several sensory an motor systems in a structured way Projects - FMT

22. 22 Tactile perception - quality, cold and warmth, different materials in the drumsticks, form, distance, direction, angle and position in the grip of the hands, pressure against the supporting part of the body, etc. Perception of vibrations - quality, strength, direction, tempo, frequency in sound waves sent to the brain from the hands, supporting parts of the body, vibrations from wind instruments and body movement, etc. Proprioception - direction, distance, strength, tempo, quality, etc. Vestibular perception - position, stability, direction, tempo of movement, flow of movement, strength of movement and muscles, etc. Viscelar perception - strength, use of energy, tempo, etc. Projects - FMT

23. 23 The variation in placement of the instruments also gives the chance for a great processing of motor activity; Development of gross motor ability - is promoted while working with breathing, balance, stability of the body, cross movements, parallel movement in both sides of the body and coordination between hand and feet. It is also promoted when stimulating rotation of the upper part of the body while the trunk is stable in sitting or standing position. Development of fine motor skills - is promoted while working with the grip and position of the hands, movement of the wrists, angle of the hands and eye-to-hand coordination. Projects - FMT

24. 24 Accuracy and Validation Validation and Accuracy Tests - Overview Internal – data consistency and reproducibility of results over repeated trials Independent Studies by German Sport University Cologne – Institute for Biomechanics and Orthopedics (Prof. Brueggemann) OM with Goniometer OM with FAB (inertial system) OM with 2D video analysis OM with Vicon

25. 25 Benefits Reducing time and cost doing Motion Capture Eliminating subject setup Instant access Real-time visual feedback and data Minimized operating/maintenance cost Multi-discipline and interdepartmental use Non-intrusive – movements less contrived, natural Remote access via distributed network True data consistency across setups and operators Benefits

26. 26 IntroductionOrganic MotionBioStageQ/A Thank you! Q & A Alex Czarowicz alex@organicmotion.com Organic Motion, Inc. 15 West 37th Street, 7th Floor New York, NY 10018 212-776-6100 x 211 Questions