Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Florian Biermann Nikolaas Steenbergen Benjamin Walther-Franks TZI Universität.

Slides:



Advertisements
Similar presentations
                      Digital Audio 1.
Advertisements

Sharing Content and Experience in Smart Environments Johan Plomp, Juhani Heinila, Veikko Ikonen, Eija Kaasinen, Pasi Valkkynen 1.
C1 - The Impact of CAD on the Design Process.  Consider CAD drawing, 2D, 3D, rendering and different types of modelling.
Digital Interactive Entertainment Dr. Yangsheng Wang Professor of Institute of Automation Chinese Academy of Sciences
By : Adham Suwan Mohammed Zaza Ahmed Mafarjeh. Achieving Security through Kinect using Skeleton Analysis (ASKSA)
SM1205 Interactivity Topic 01: Introduction Spring 2012SCM-CityU1.
Technology in Media Production By Mike Pasqualetto.
Game Development with Kinect
SM1205 Interactivity Topic 01: Introduction Spring 2011SCM-CityU1.
“ Walk to here ” : A Voice Driven Animation System SCA 2006 Zhijin Wang and Michiel van de Panne.
Bus. Computer Applications Supervised by: t. Ahmed Abu msameh Prepared by Mohammed fathi al – amawi ID : CCTV systems.
ICT Tools and Usage Media and ICT for Teaching Ima Nurhayati VI.E.
Page 1 | Microsoft Introduction to audio stream Kinect for Windows Video Courses.
Television Production Team. Standard 7.0 Standard Text: Exhibit knowledge of the television production team. Learning Goal: Students will be able to understand.
Game Peripherals BRAD SAYE. The computer mouse Douglas Engelbart at the Stanford Research Institute (now SRI International) invented the first mouse prototype.
Old Fashioned Type Movies with New Technology. C-l-a-y-m-a-t-i-o-n or S-t-o-p A-n-i-m-a-t-i-o-n Making pictures come to life.
Paper Prototyping Source:
Research & Development Project Frequency Festival Michael Burton.
Using an Ipad to teach English. Why use an Ipad Using an Ipad to teach is a good Idea as teachers can access more information in order to help get the.
Kinect Part II Anna Loparev.
Professor : Yih-Ran Sheu Student’s name : Nguyen Van Binh Student ID: MA02B203 Kinect camera 1 Southern Taiwan University Department of Electrical Engineering.
SDP 12 Project “PRASER” Senior Design Project Final Project Review Team Mosaic Advisor: Professor Lixin Gao Members: Allen Chew, Charles Essien, Brian.
Digital Media Dr. Jim Rowan ITEC 2110 Animation. Two ways to create moving images Capture using a camera Create using animation techniques.
MARCH 27, Meeting Agenda  Prototype 1 Design Goals  Prototype 1 Demo  Framework Overview  Prototype 2 Design Goals  Timeline Moving Forward.
Funativity presents: CS 426 Fall Team Members David Smits – Lead Chintan Patel – Programmer Jim Gagliano – Programmer Ashleigh Wiatrowski - Artist.
INTRODUCTION Generally, after stroke, patient usually has cerebral cortex functional barrier, for example, the impairment in the following capabilities,
Digital Blue Cameras Inset Tuesday 3 rd June 2008.
Digital Media Dr. Jim Rowan ITEC 2110 Animation. Two ways to create moving images Capture using a camera Create using animation techniques.
Capturing, Encoding and Rendering Gestures using the Kinect Adan Patience Supervisor: Mr. Mehrdad Ghaziasgar Co-Supervisor: Mr. Reginald McDonald Dodds.
CS 425 Game Programming I Jan M. Allbeck. Outline  Introductions  Expectations  Tools and setup  Quick introduction to C++ and Visual Studio  What.
Project By: Brent Elder, Mike Holovka, Hisham Algadaibi.
EVERY CONNECTION has a starting point. NetLibrary eAudiobooks Media Center Overview Nathan Downing Field Implementation Specialist & Training Developer.
3D Animation 5. Character Animation Dr. Ashraf Y. Maghari Information Technology Islamic University of Gaza Ref. Book: The Art of Maya.
COMPUTER PARTS AND COMPONENTS INPUT DEVICES
Project By: Brent Elder, Mike Holovka, Hisham Algadaibi.
Yingcai Xiao Game Development Interactive Animation.
Clever Framework Name That Doesn’t Violate Copyright Laws MARCH 27, 2015.
Evaluation of ‘BigIdiots Production’ By stephanie Roberts.
 The meaning of multimedia is the use of a variety of artistic or communicative media.
 Designed to monitor the movement of people in given area.  Used video cameras to transmit a signal to a specific place on a limited set of monitors.
A Look To The Future Next-Generation User Interfaces By: John Garcia.
WEBSITE BUILDING SOFTWARE Google By Ishaan Kochhar.
TownMUD An Interface for a Text-Based Multiple User Dimension.
Professor : Tsung Fu Chien Student’s name : Nguyen Trong Tuyen Student ID: MA02B208 An application Kinect camera controls Vehicles by Gesture 1 Southern.
NVIDIA FX Composer 2 Shader Authoring for Everyone Philippe Rollin Aravind Kalaiah.
ICT in Education. 2 key points you need to learn/understand/revise Use of computers for teaching and learning Use of computers for school/college administration.
Jessica King Q.4: HOW DID YOU USE NEW MEDIA TECHNOLOGIES IN THE CONSTRUCTION AND RESEARCH, PLANNING AND EVALUATION STAGES?
CONTENT 1. Introduction to Kinect 2. Some Libraries for Kinect 3. Implement 4. Conclusion & Future works 1.
How Computers Work … and how you can work them. Art 311 Lecture 04 Dr. J Parker.
PhoneBrew (Home Brewing SDS) Mike Foster LING575 Spring 2013.
Super EastGate Jon Caron, Ryan Fleming, Antonio Guarino, and Mike LoVerme Merrimack College Introduction Super EastGate is a 2D side scroller game that.
Basil Fierz Benjamin Schindler Henning Avenhaus Game Development Lab SS 07 Project: Gravity Bound.
Paper Prototyping Source: Paper Prototyping a method of brainstorming, designing, creating, testing, refining and communicating.
1 Multi-Track Recorder Typical Usage Scenario Demonstration.
-BY SAMPATH SAGAR( ) ABHISHEK ANAND( )
Digital Media Dr. Jim Rowan ITEC 2110 Animation. Two ways to create moving images Capture using a camera –edit in a video editor like iMovie Create using.
G2 Presentation Week 12 Rehearsal. Outline Demo User Testing Internal External Improvements Project Management.
A Gesture Based System Humanize Technology.  Communication is the way we learn.  What about learners with communication difficulties?  Make technology.
Fundamentals of Computer Animation Motion Synthesis.
Cliff Animation Phone:
On Wikipedia you can find the following definition of NUI: “In computing, a natural user interface, or NUI, or Natural Interface is the common parlance.
We are an energetic and dynamic young company having specialization in the fields of Electronics and Communication, Mechanical Systems and Robotics. We.
Preliminary project assignment Smart house Natural User Interface for Business NUIT4B.
Interactive Animation
2N IP Intercoms Advanced Settings 2017.
What is Hallowcast? Hallowcast is a Steampunk RPG in which you play as an inventor called John Hallowcast. After one of his inventions turns against him,
Make your own animated videos
“How did they do that … Kelvin Cording July 2018.
Interactive media.
Presentation transcript:

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Florian Biermann Nikolaas Steenbergen Benjamin Walther-Franks TZI Universität Bremen BLOOP Rapid Motion Capturing using Blender and Kinect

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Who Are We?  Florian Biermann and Nikolaas Steenbergen  Studied Digital Media B.Sc. at the University of Bremen  Just finished their theses using Blender  “Automated Camera Placement to View Three-Dimensonal Curves“  “Timing Techniques for Three Degree-of-Freedom Input Devices“

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de What is Bloop? ''The Bloop is the name given to an ultra-low frequency and extremely powerful underwater sound detected by the U.S. National Oceanic and Atmospheric Administration (NOAA) in 1997.'' (

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de What is Bloop? Bloop: Blender Loop Station

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de What is Bloop? Bloop is a Python add-on for Blender 2.59 that brings speech controlled Motion-Capturing and Digital Puppetry to home users using Microsoft Kinect.

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Motivation  Key-frame animation takes a lot of time  Experimenting during production? No way!  Other artists are unable to enjoy computer animation  Actors  Puppeteers  Simply beginners  Also, in general motion capturing equipment is very expensive  Pretty much no home-user can do mo-cap  Additionally, single user mo-cap is pretty cumbersome

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Motivation ''A user should be able to fully animate a 3D character with a minimum amount of time, experience and technological knowledge required and without breaking his or her work flow by using different modes of interaction.''

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Idea Implement a system in style of a loop station as used by musicians but with modal channels switched. SoundRecorded Footage MotionControl Input

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Idea Implement a system in style of a loop station as used by musicians but with modal channels switched. SoundRecorded Footage MotionControl Input

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Idea Speech commands Motion capturing OSC data Motion Speech commands OSC data

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Demo BLOOP DEMO!

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Main Features  Create new mappings via gestures  Calibrate these mappings  Quickly record animations  Layer recordings for different mappings  Record animations with more than one user acting on the same character

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Commands  Basic set of speech commands  Mapping  Calibration  Recording  Start  Next  Previous Mapping Calibration Recording

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Technical Aspects  OSC Client (Sender) with Microsoft Kinect SDK  Microsoft Speech API  Skeleton Data  Bespoke OSC library (  C#  NUI Add-on  Receives OSC data  pyOSC (  Python  Bloop Add-on  Manipulates the selected 3D character  Reads data from NUI Add-on  Modal operator based on timer  Python

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de What‘s It Good For?  Intended to let novice users and other artists create 3D animations  Digital Puppetry  Performance animation  Live performances  Animation prototyping  Get a first impression of your scene  Experimenting  Extend upon and play with it  It‘s fun!

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de Download  Visit our project website at: dm.tzi.de/research/hci/bloop  Available for download

Florian Biermann, Nikolaas Steenbergen and Benjamin Walther Franks dm.tzi.de End Thanks for listening! Shoot us an Enjoy the other talks!