Thuong Hoang Supervisor: Prof. Bruce Thomas Wearable Computer Lab School of Computer and Information Science In-situ Model Refinement and Hands-free Interaction Techniques for Outdoor AR

Contents Literature review Research question Contributions Conclusion

Literature review Surveying current research in the field of Augmented Reality

Augmented Reality (AR) Immersively supplement real world with virtual information, using Head-mounted display.

Tinmith Wearable outdoor AR system Backpack computer Immersive head mounted display (HMD) State-of-the-art wearable outdoor immersive AR system

Menu system Pinch glove menu for command executions

Applications ARQuake X-Ray Vision ARWeather

Applications Modelling Infinite planes Place existing models

Limitations ModellingInteraction Coarse modelling, no support for details Simple model Pinch glove menu system Require both hands Occupied screen space at all times

Modelling in AR BenefitsChallenges In-situation contextual information Instantaneous verification and visualisation of models Limitations in input devices Lack of methods for sampling real world artefacts

Interaction AimsChallenges Menu system Hands-free Unobstrusive Input devices or interaction techniques Visualisation

Research Question What is the most suitable techniques to assist modelling tasks perform hands-free menu interaction in outdoor augmented reality?

Contribution Offering the solutions to the research questions

Technique for model refinements

Laser rangefinder Imaged-based reconstruction (Sequeira et al. 1999) ‘Left: Automatic capture robot Right: Mesh model of environment

Virtual pointer Orientation sensor + Laser rangefinder

Modelling refinements - Laser Rangefinder Use of laser rangefinder for AR modelling

Benefits Other 3D scanner methodsCurrent Tinmith Selective modelling Only model the required part Different density No post processing Models are created using triangulation. No off-site processing Small, high detailed feature. Complex polygonal models Depending on the triangulation algorithm used

Technique for hands-free interaction via a menu system

3D Menu Ring menu (Liang & Green 1993) Spin menu (Gerber & Bechmann 2005)

Walkin’ Menu 3D menu items placed within the environment Activate by looking down Execute by stepping onto menu item

Benefits Hands-free Tracking user position, step on menu to activate Unobtrusive Constructed on demand Part of the environment Multi-purpose Command execution Textual and image display

Publications Hoang, TN, and Thomas, BH 2009, “In-situ refinement techniques for outdoor geo- referenced models using mobile AR”, to appear in Proceedings of the 10 th International Symposium on Mixed and Augmented Reality” (ISMAR2009), Orlando, USA, October Hoang, TN, Porter, SR, Close, B, and Thomas BH 2009, “Web 2.0 meets augmented reality”, in Proceedings of the Thirteenth International Symposium on Wearable Computers (ISWC2009), Linz, Austria, pp Hoang, TN, Porter, S, and Thomas, B 2009, “Augmenting image plane AR 3D interactions for wearable computers”, Proceedings of the Tenth Australasian User Interface Conference (AUIC2009), Wellington, New Zealand. Hoang, TN 2009, “Augmented reality in-situation menu of 3D models”, Proceedings of the 3 rd Int’l Workshop on Ubiquitous Virtual Reality (IWUVR2009), Adelaide. Hoang, TN 2009, “Augmenting reality 3D interactions for wearable computers”, Proceedings of the 3 rd Int’l Workshop on Ubiquitous Virtual Reality (IWUVR2009), Adelaide. Hoang, TN and Thomas, B 2008, “Augmented reality In-situ 3D model menu for outdoors”, Proceedings of the 7 th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR2008).

Conclusion Techniques for: Model refinements using an orientation-sensed single-point laser rangefinder Hands-free interaction via walkin’ menu

Disclaimer The contents of this presentation should only be viewed in conjunction with the minor thesis document to be published online from 26 th October 2009, at