1. IENV3000 PROTOTYPE TEAM CHANG “Simply revolutionary.” - Plato

2. TEAMWORK  Emphasis on communication  At least bi-weekly meetings in person (usually more)  Skype/IM conversations very frequently  Work split into small groups (2 people)  Version control for code (git)  Dropbox to share files and collaborate

3. WHERE WE’RE AT NOW [ACHIEVEMENTS]  IR Glove and Modes of interaction  IR Recognition  Floor projection  Mapping LED position to projected objects  When LED turns on, the code can map it as a mouse

4. DESIGN PROCESS  Gesture Interaction  IR Filters/Camera  Glove Construction

5. Move: 1 hand grip Move: flick, 2 hand pickup, 1 hand grip Rotate: 2 hands Move: 1 hand grip Rotate: 2 hands grip and rotate Move: 1 hand grip in middle Rotate: 1 hand grip at corner GESTURE INTERACTION

6. Move: 1 hand grip Move: flick, 2 hand pickup, 1 hand grip Rotate: 2 hands Move: 1 hand grip Rotate: 2 hands grip and rotate Move: 1 hand grip in middle Rotate: 1 hand grip at corner

7.  Use of context may have user carry around the catalogue iPad  This means user can only perform gestures with one hand GESTURE INTERACTION Move: 1 hand grip Move: flick, 2 hand pickup, 1 hand grip Rotate: 2 hands Move: 1 hand grip Rotate: 2 hands grip and rotate Move: 1 hand grip in middle Rotate: 1 hand grip at corner

8. GESTURE INTERACTION Move: 1 hand grip Move: flick, 2 hand pickup, 1 hand grip Rotate: 2 hands Move: 1 hand grip Rotate: 2 hands grip and rotate Move: 1 hand grip in middle Rotate: 1 hand grip at corner Move: 1 hand grip Rotate: 2 hand grip and rotate Delete: On virtual catalogue

9. Possible filtersiSight/webcamsXbox kinect Kinect advantages INFRARED FILTERS / CAMERA

10. Possible filtersiSight/webcamsXbox kinect Kinect advantages

11. INFRARED FILTERS / CAMERA Possible filtersiSight/webcamsXbox kinect Kinect advantages

12. up to 10 meters IR light Kinect INFRARED FILTERS / CAMERA Possible filtersiSight/webcamsXbox kinect Kinect advantages

13. Materials and components IR LEDs circuitsGlove design Iterative process and construction INFRARED GLOVE CONSTRUCTION

14. Materials and components IR LEDs circuitsGlove design Iterative process and construction

15. INFRARED GLOVE CONSTRUCTION Materials and components IR LEDs circuitsGlove design Iterative process and construction

16. INFRARED GLOVE CONSTRUCTION Materials and components IR LEDs circuitsGlove design Iterative process and construction

17. Technology Investigation Obtaining IR video feed Detecting motion Send motion data to another program INFRARED RECOGNITION +

18. Technology Investigation Obtaining IR video feed Detecting motion Send motion data to another program INFRARED RECOGNITION AS3 library as3-server (in C) Microsoft Kinect

19. Technology Investigation Obtaining IR video feed Detecting motion Send motion data to another program INFRARED RECOGNITION

20. Technology Investigation Obtaining IR video feed Detecting motion Send motion data to another program INFRARED RECOGNITION IR Recognition Application Custom Server Design Application Motion data

21. Creating visual representation of products Moving product representations Future Development DESIGN APPLICATION Classes in AS3 extend Sprite

22. Creating visual representation of products Controlling product representations Future Development DESIGN APPLICATION

23. Creating visual representation of products Moving product representations Future Development DESIGN APPLICATION

24. SUCCESS CRITERIA Conceptual:  Most people can interact with minimal assistance  Majority of users spend > 1 minute using system  Most people can learn the interaction in >30 seconds Technological:  Users don’t need assistance to put on gloves/arm straps  Accurate mapping of IR/Fluid motion (>0.5s delay)  No shadows that inhibit use of system  Every user can move and rotate with intended gestures

25. WHERE WE AIM TO GET  Digital catalogue functioning on portable device  Catalogue can add/remove products to floor space  Acquire 3D models  Augmented Reality  Polishing existing work

26. INTERACTION PLAN [DEMO]  Put on gloves and catalogue  Select products from catalogue  Move/Rotate objects by grabbing and moving hands  View augmented 3D models on screen

27. DEMONSTRATION

28. OpenKinect - http://openkinect.org/wiki/Main_Pagehttp://openkinect.org/wiki/Main_Page AS3Kinect - http://www.as3kinect.org/http://www.as3kinect.org/ LED series/parallel array wizard - http://led.linear1.org/http://led.linear1.org/ Led.wizProjection Calculator Pro - http://www.projectorcentral.com/Dell-S300- projection-calculator-pro.htmhttp://www.projectorcentral.com/Dell-S300- projection-calculator-pro.htm Augmented Reality - http://www.youtube.com/watch?v=1jaXk4Z1OgMhttp://www.youtube.com/watch?v=1jaXk4Z1OgM QR codes - http://www.youtube.com/watch?v=tWHYnuB7OYwhttp://www.youtube.com/watch?v=tWHYnuB7OYw Floppy as IR Filter - http://hackscape.wordpress.com/2010/11/27/using-a-floppy-disk- as-an-ir-filter/http://hackscape.wordpress.com/2010/11/27/using-a-floppy-disk- as-an-ir-filter/ LINKS/BACKGROUND RESEARCH