1. Multi-interface gesture based organic modelling Bradley Wesson

2. Overview Background Rationale Development Issues Testing Conclusion and Future Work

3. Background – The problem “Designers know more than they can say” (Schön, 1992) “[creative interfaces] should capture users’ intended ambiguity, vagueness, and imprecision and convey these qualities visually and through interactive behavior” (Gross, 1996) “computer models […] are typically considerably more difficult to create [than with pen and paper].” (Zeleznik, et al., 2006)

4. Background – Current solutions ILoveSketch (Bae, Balakrishnan, & Singh, 2008) FiberMesh (Nealen, Igarashi, Sorkine, and Alexa, 2007)

5. Project Combine Kinect with Mobile for more natural interactions  Natural gestures  Virtual “tool”  Buttons and orientation sensing

6. Project – Interactions  Kinect  Right hand for interactions  Clench fist to grab geometry  Both hands to reorient model  Left hand to change size  Kinect+Mobile  Virtual tool  Physical button to grab geometry  Two fingers on screen to reorient  Left hand to change size

7. Project - Demo

8. Project – Mobile  Device orientation, buttons, touch screen  TCP connection over Ad Hoc network  Send 20 packets per second  Prevent flooding network 1 0 1 0 1 0

9. Project – The model  Stored as voxels  Valve 0.5-depth threshold  Voxels “smudged” Marching Cubes: A high resolution 3D surface construction algorithm (Lorensen & Cline, 1987) Improved Alpha-tested Magnification for Vector Textures and Special Effects (Green, 2007)

10. Project – Rendering  Depth perception  Lighting, transparency

11. Issues  Trouble determining depth of interaction relative to geometry  Inaccuracies of mobile sensors make linear acceleration unreliable  Poor development platform choice Translation Acceleration Velocity

12. Timeline Testing Thesis Expo Rslts Seminar Mid-project 2012 2013 Ethics Development Lit Review Proj Proposal MayMarchJanuaryNovemberSeptemberJulyMayMachJuly

13. Timeline - Revised Testing Thesis Expo Rslts Seminar Mid-project 2012 2013 Ethics Development Lit Review Proj Proposal MayMarchJanuaryNovemberSeptemberJulyMayMachJuly C++ Prototype C# Rebuild XNA Port Always finding new papers!

14. Testing / Measurements Modelling a teapot Measurements  Observation  Survey  NASA TLX

15. Evaluation  Quality of product  Speed of execution  Measured workload  Perceived ease of use  Perceived speed  Enjoyment I’m not using that!

16. Conclusion  Development process  Accuracy  Built around creative expression  Multi-interface testing  Future work  Implement Kalman filter for linear acceleration  Painting and texture  Animation

17. Questions ?