1. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Florian Biermann Nikolaas Steenbergen Benjamin Walther-Franks TZI Universität Bremen BLOOP Rapid Motion Capturing using Blender and Kinect

2. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Who Are We?  Florian Biermann and Nikolaas Steenbergen  Studied Digital Media B.Sc. at the University of Bremen  Just finished their theses using Blender  “Automated Camera Placement to View Three-Dimensonal Curves“  “Timing Techniques for Three Degree-of-Freedom Input Devices“

3. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de What is Bloop? ''The Bloop is the name given to an ultra-low frequency and extremely powerful underwater sound detected by the U.S. National Oceanic and Atmospheric Administration (NOAA) in 1997.'' (http://en.wikipedia.org/wiki/Bloop)

4. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de What is Bloop? Bloop: Blender Loop Station

5. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de What is Bloop? Bloop is a Python add-on for Blender 2.59 that brings speech controlled Motion-Capturing and Digital Puppetry to home users using Microsoft Kinect.

6. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Motivation  Key-frame animation takes a lot of time  Experimenting during production? No way!  Other artists are unable to enjoy computer animation  Actors  Puppeteers  Simply beginners  Also, in general motion capturing equipment is very expensive  Pretty much no home-user can do mo-cap  Additionally, single user mo-cap is pretty cumbersome

7. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Motivation ''A user should be able to fully animate a 3D character with a minimum amount of time, experience and technological knowledge required and without breaking his or her work flow by using different modes of interaction.''

8. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Idea Implement a system in style of a loop station as used by musicians but with modal channels switched. SoundRecorded Footage MotionControl Input

9. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Idea Implement a system in style of a loop station as used by musicians but with modal channels switched. SoundRecorded Footage MotionControl Input

10. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Idea Speech commands Motion capturing OSC data Motion Speech commands OSC data

11. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Demo BLOOP DEMO!

12. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Main Features  Create new mappings via gestures  Calibrate these mappings  Quickly record animations  Layer recordings for different mappings  Record animations with more than one user acting on the same character

13. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Commands  Basic set of speech commands  Mapping  Calibration  Recording  Start  Next  Previous Mapping Calibration Recording

14. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Technical Aspects  OSC Client (Sender) with Microsoft Kinect SDK  Microsoft Speech API  Skeleton Data  Bespoke OSC library (http://www.bespokesoftware.org)  C#  NUI Add-on  Receives OSC data  pyOSC (http://docs.ryancoyner.com/python-osc)  Python  Bloop Add-on  Manipulates the selected 3D character  Reads data from NUI Add-on  Modal operator based on timer  Python

15. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de What‘s It Good For?  Intended to let novice users and other artists create 3D animations  Digital Puppetry  Performance animation  Live performances  Animation prototyping  Get a first impression of your scene  Experimenting  Extend upon and play with it  It‘s fun!

16. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Download  Visit our project website at: dm.tzi.de/research/hci/bloop  Available for download

17. Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de End Thanks for listening! Shoot us an e-mail: Nikolaas.Steenbergen@online.de fbier@tzi.de Enjoy the other talks!