Welcome Basic Concept Research Justification The Project Implementation Potential Issues Future Work What am going to talk about?

What am I interested in? Bringing the interactor into the experience Merging virtual and physical space Allowing for natural body movement during interaction Permitting physical objects to be used as interface devices Exploring tangible interaction Basic Concept

OK, but why? Research Justification Discover new forms of interaction Exploration of ambient intelligence Model for future ubiquitous computing applications Get us out from behind our desks No more carpel tunnel syndrome!

OK, but why? Research Justification But mostly because I think it’s cool!

Swarm: An Augmented Reality Experience The Project You reach into a box that appears to have a transparent top. Inside are two colored balls. You grab the balls, one in each hand, which causes colored particles to begin to swarm. The particles are drawn to the balls and move both in front of and behind your hands like magical fireflies, following every gesture that you make.

Form Factor The Project

How does it work? Implementation Augmented Reality + Video Chroma Key

The Compositing Process Implementation

How does it work? Implementation Hardware Box Projector Colored Balls Software Jitter Processing

Hardware Implementation The Box Green Rear Wall Mirror Lights Webcam

Inside the Box Implementation

Software Implementation Jitter Color Detection Track hand positions Send data to Proce55ing

Software Implementation Proce55ing Chroma Key Draw the particles Recombine the 3 video layers

Primary Concerns Potential Issues Processing Power Distributed Computing Multiple Computers WebCam Camera Angle Wide Angle Lens Video Chroma Key Issues

Where do I go from here? Future Work Graphics Incorporate 3d Animation Ambient Intelligence Make the balls “clickable” Scale Full body Experiences

FIN Thank you!