IENV3000 PROTOTYPE TEAM CHANG “Simply revolutionary.” - Plato

TEAMWORK  Emphasis on communication  At least bi-weekly meetings in person (usually more)  Skype/IM conversations very frequently  Work split into small groups (2 people)  Version control for code (git)  Dropbox to share files and collaborate

WHERE WE’RE AT NOW [ACHIEVEMENTS]  IR Glove and Modes of interaction  IR Recognition  Floor projection  Mapping LED position to projected objects  When LED turns on, the code can map it as a mouse

DESIGN PROCESS  Gesture Interaction  IR Filters/Camera  Glove Construction

Move: 1 hand grip Move: flick, 2 hand pickup, 1 hand grip Rotate: 2 hands Move: 1 hand grip Rotate: 2 hands grip and rotate Move: 1 hand grip in middle Rotate: 1 hand grip at corner GESTURE INTERACTION

Move: 1 hand grip Move: flick, 2 hand pickup, 1 hand grip Rotate: 2 hands Move: 1 hand grip Rotate: 2 hands grip and rotate Move: 1 hand grip in middle Rotate: 1 hand grip at corner

 Use of context may have user carry around the catalogue iPad  This means user can only perform gestures with one hand GESTURE INTERACTION Move: 1 hand grip Move: flick, 2 hand pickup, 1 hand grip Rotate: 2 hands Move: 1 hand grip Rotate: 2 hands grip and rotate Move: 1 hand grip in middle Rotate: 1 hand grip at corner

GESTURE INTERACTION Move: 1 hand grip Move: flick, 2 hand pickup, 1 hand grip Rotate: 2 hands Move: 1 hand grip Rotate: 2 hands grip and rotate Move: 1 hand grip in middle Rotate: 1 hand grip at corner Move: 1 hand grip Rotate: 2 hand grip and rotate Delete: On virtual catalogue

Possible filtersiSight/webcamsXbox kinect Kinect advantages INFRARED FILTERS / CAMERA

Possible filtersiSight/webcamsXbox kinect Kinect advantages

INFRARED FILTERS / CAMERA Possible filtersiSight/webcamsXbox kinect Kinect advantages

up to 10 meters IR light Kinect INFRARED FILTERS / CAMERA Possible filtersiSight/webcamsXbox kinect Kinect advantages

Materials and components IR LEDs circuitsGlove design Iterative process and construction INFRARED GLOVE CONSTRUCTION

Materials and components IR LEDs circuitsGlove design Iterative process and construction

INFRARED GLOVE CONSTRUCTION Materials and components IR LEDs circuitsGlove design Iterative process and construction

INFRARED GLOVE CONSTRUCTION Materials and components IR LEDs circuitsGlove design Iterative process and construction

Technology Investigation Obtaining IR video feed Detecting motion Send motion data to another program INFRARED RECOGNITION +

Technology Investigation Obtaining IR video feed Detecting motion Send motion data to another program INFRARED RECOGNITION AS3 library as3-server (in C) Microsoft Kinect

Technology Investigation Obtaining IR video feed Detecting motion Send motion data to another program INFRARED RECOGNITION

Technology Investigation Obtaining IR video feed Detecting motion Send motion data to another program INFRARED RECOGNITION IR Recognition Application Custom Server Design Application Motion data

Creating visual representation of products Moving product representations Future Development DESIGN APPLICATION Classes in AS3 extend Sprite

Creating visual representation of products Controlling product representations Future Development DESIGN APPLICATION

Creating visual representation of products Moving product representations Future Development DESIGN APPLICATION

SUCCESS CRITERIA Conceptual:  Most people can interact with minimal assistance  Majority of users spend > 1 minute using system  Most people can learn the interaction in >30 seconds Technological:  Users don’t need assistance to put on gloves/arm straps  Accurate mapping of IR/Fluid motion (>0.5s delay)  No shadows that inhibit use of system  Every user can move and rotate with intended gestures

WHERE WE AIM TO GET  Digital catalogue functioning on portable device  Catalogue can add/remove products to floor space  Acquire 3D models  Augmented Reality  Polishing existing work

INTERACTION PLAN [DEMO]  Put on gloves and catalogue  Select products from catalogue  Move/Rotate objects by grabbing and moving hands  View augmented 3D models on screen

DEMONSTRATION

OpenKinect - AS3Kinect - LED series/parallel array wizard - Led.wizProjection Calculator Pro - projection-calculator-pro.htmhttp:// projection-calculator-pro.htm Augmented Reality - QR codes - Floppy as IR Filter - as-an-ir-filter/ as-an-ir-filter/ LINKS/BACKGROUND RESEARCH