1. LEAP MOTION: GESTURAL BASED 3D INTERACTIONS
Thanh Nguyen and Tammy Dinh
CS320: User Interface

2. What is Leap Motion? - Is a computer hardware sensor device
- Enables users to interact with the computer using hand motion
- Developed and marketed by Leap Motion Co. in May, 2012

3. What is Leap Motion? Computer hardware sensor device
Enables users to interact with the computer using hand motion
Developed and marketed by Leap Motion Co. in May, 2012

4. Demo
Playground

5. How does Leap Motion work?
Size of a matchbox
is placed horizontally on the desktop in front of the computer screen
It enables continuous tracking of multiple hands with high accuracy
Leap Motion controller and the coordinate system used to describe positions in sensory spaces

6. How does Leap Motion work?
Controller has two cameras and three infrared LEDs
Hardware:
Scans infrared light to capture the surrounding
Generates greyscale stereo image of the near-infrared light spectrum
Software:
Analyzes and reconstructs 3D representation of the greyscale image
Extracts tracking information (hands, fingers, & gestures)
Diagnostic visualizer:
Shows real-time image input and virtual hand output
These track infrared light with a wavelength of 850 nanometers, which is outside the visible light spectrum
Distinguish foreground object from background
Thanks to its wide angle lenses, the device has a large interaction space of eight cubic feet, which takes the shape of an inverted pyramid – the intersection of the binocular cameras’ fields of view

7. Applications Medical (e.g. physical therapy for rehab)
Education (e.g. medical training)
Gaming
Music, art, & design
UI/UX design
VR/AR

8. Demo
Cyber Science Motion Zoology

9. Benefits Portable Affordable
Provides more intuitive ways to interact with 3D user interfaces
Well-documented API

10. Drawbacks Limited sensory space
Inconsistent across different LM software
Premature community for developers

11. Using Leap Motion with VR

12. Setting up in Unity
Requires either V2 SDK for Desktop applications or Orion SDK for VR
Essential asset is Core – available on the website
Drag and drop prefabs & configure attributes

13. Questions?