Video Eyewear for Augmented Reality Presenter: Manjul Sharma Supervisor: Paul Calder

Outline 1)Introduction 2)Recap 3)Goal 4)Platform 5)Mobile App 6)Experiment details 7)Demo 8)Limitation 9)Status

Introduction Augmented Reality is a process of superimposing computer generated images on to the user view of their surroundings. Output Devices for AR applications : 1.Head Mounted displays: a)Video see through devices - presents the feeds from the camera into the head mounted display. b) Optical see through devices - combine visual images generated by computer with the actual view through a slanted semi-transparent mirror. 2. Mobile Phones

Recap Video Eyewear as an Output Display  Uses a dedicated video screen for the virtual digital information on top of the real view  Permit user to see the real world in parallel with virtual information displayed on eyewear  Used with iPod, iPhone and other PDA’s.  Advantages: Safe to use – no disturbance in field of view Easily Accessible – plenty of brands are available in market Convenient to use – worn on the eye rather than on head No Brightness issues

Goal Video Eyewear as output display Can we use Video Eyewear for AR applications? How useful it will be? Steps Involve: 1.Choosing appropriate Hardware & Software 2.AR Application Development which uses Video Eyewear for output display 3.Experiment on users and collection of data.

Platform 1.Choosing Hardware & Software Apple iPhone 4 MYVU Solo Plus EV Standard edition player MYVU Connecting cable Apple iOS SDK 4.3

Mobile Application Developed an Interface which can be used with any application to display output on Video Eyewear. Uses orientation and location to interact with the application Gyroscope, Compass and GPS as an input App 1 uses an Arrow marker which will move according to mobile orientation App 2 displays information based on location and compass

Experiment Details Users will be asked to perform simple orientation and navigation tasks based on the information shown on the eyewear Video eyewear will be placed just below the line of sight and only pure virtual information will be displayed Mobile would be attached to the head of a person to capture the head orientation  Experiment 1 will check the orientation accuracy  Experiment 2 will check the usability and will involve searching of a location by walking on a particular path wearing this eyewear.

Experiment Details Key Findings:  Collection of user experience and feedback of using Video Eyewear for AR applications  Investigation of accuracy of Video Eyewear for location specific tasks  Comparison with Mobile Screen as an output display.  Identify future AR applications research area

Video Demo Video Link

Limitations 1.Using the pose of eyewear rather than the pose of the camera on phone 2.Live camera feed is not supported 3.Supports mainly indirect interaction 4.Hardware used is very rare to get.

Status Hardware is working AR Application is developed Experiment is designed No issues with Ethics application ×Collection of Data (waiting for the ethics approval)

Thank You & Questions?