1. Augmented Reality in Mobile Applications and
Its Potential for User Engagement
Vika Nightingale
Horizon Digital Economy Research Institute
University of Nottingham

2. Natural progression: Ubiquitous computing and devices at hand

3. “Smart” Everyday Devices
Six Degrees of Freedom:
freedom of movement of a rigid body in three-dimensional space
Location positioning:
geographic coordinate system,
compass bearings,
accelerometer readings
Radio Frequency Identification (RFID):
technologies that use radio waves to identify people or objects
and other wireless technologies

4. What is Augmented Reality?

5. contextualised manner
Augmented Reality - an approach to the interaction between humans and the environment and the associated technology. in
physical environment
contextualised manner
real time
P.S. content always needs to be triggered

6. IKEA furniture catalogue

7. Rise of global interest towards other realities: Virtual and Augmented

8. Early adopters 2009-2011 V&A - Decode exhibition Louvre Street Museum
Wimbledon 2010
Street Museum
Museum of London
Getty Museum

9. UK AR Landscape beyond 2011

10. Functionality of a system is defined by the set of actions or services that it provides to its user.
Usability of a system with a certain functionality is the range and degree by which the system can be used efficiently and adequately to accomplish certain goals for certain users.

11. Purpose: visual representation (3D modelling) - e.g. Google SketchUp
historical reconstruction / environmental observations- e.g. Berlin Wall, Hermes tours
navigation in space/ outdoor explorations - e.g. Spyglass, Around Sydney - Powerhouse
gaming - e.g. BMW Z4 app
creative - e.g. Toyota 86 app - video making
testing products- e.g. make-up testing, wall art
kinetic learning - e.g. British Museum - Passport to the Afterlife
public database - e.g. Urban Tapestries
education - e.g. Carbon Cycle
take-away value - e.g. Paradise Wildlife Park
social sharing - e.g. EDF at London 2012
virtual exhibitions - Hidden Garden
Purpose:

12. How does one arrive at AR? (prompt)
Approach to Experience
Flowchart
What is offered via AR?
How does one arrive at AR? (prompt)
Where is AR found?
What triggers AR?
What follows after AR?
What happens during AR?
What can one do with AR?

13. How does one arrive at AR?
Example:
Living History: Union Station Kansas City
10 personalized stories (audio and video) overlaying what you see through the camera.
On location mainly
Anniversary of the landmark
What is offered via AR?
How does one arrive at AR?
Where is AR found?
What triggers AR?
What follows after AR?
What happens during AR?
What can one do with AR?
Nothing
Bluetooth Low Energy (Beacon) or user prompt
Collate favourite content

14. How does one arrive at AR?
Example:
Natural History Museum
Alive Project
Skeleton turntables and 360 panoramas of the museum;
Audio: how they lived, what their world looked like and how we came to discover them;
Animations of the animals in the museum setting.
Through an app at home or on location
Released to accompany a documentary film
audio-visual engagement
What is offered via AR?
How does one arrive at AR?
Where is AR found?
What triggers AR?
What follows after AR?
What happens during AR?
What can one do with AR?
Some content can be replayed, some cannot
On location and remotely
Image of the location: museum space;
2D trigger images
Nothing

15. Categories for Evaluation
Nature of Content
Trigger
Time
Location & Positioning
Sharing & Co-Experience

16. Categories for Evaluation
Time
Encounter type: orderly, spontaneously
Time Specific v Undefined
Nature of Content
Type of Content: audio, video, etc.
Source: Users v Authority
Access: Restricted v Unrestricted
Environmental Integration:
Organic v Unnatural
Trigger
Dynamic v Static
Enabled by:
2D Visual: defined v undefined
3D Visual: defined v undefined
Location: Image v GPS
Sound
Human: Movement v Biometrics
Location & Positioning
Navigation enabled (does AR help you navigate?)
Location-specific AR v Non-location-specific AR (does it matter where you view it?)
Single v Multiple Locations
Sharing & Co-Experience
Type of experience: Private (Google Glass) v Personal (phone) v Public
Sharing: None v Output v Experience

17. Further Opportunities

18. Nature of Content Trigger
Fiducial Voice Beacons -
Science Museum with Rafael Lozano-Hemmer
Nature of Content
Source: Users v Authority
Access: Restricted v Unrestricted
Trigger
User generated triggers: 2D & 3D
Sound
Human: Movement v Biometrics
This app features a 3D view of Information Age gallery that rotates and turns with your device as you walk around. As you walk, you hear voice recordings that are stored in them.

19. Challenges

20. Augmented Reality Troubleshooting
Is the contact with trigger maintained?
Personal & Public interactions
What is the achievement?
What is offered via AR?
Why do I care?
How does one arrive at AR?
Where is AR found?
What triggers AR?
What follows after AR?
What happens during AR?
What can one do with AR?
Can I share anything?
What is the time span of AR?
“They stood too close to the marker. They had trouble holding the phone steady..”
Can AR be captured?

21. Follow-up research and design opportunities:
in AR and user experience overall

22. modify AR experience: select the relevant content and/or create your own AR content;
distribute AR content;
ability to leave digital footprints;
ability for the AR content to transform over time: time of the day, time of the year;
ability of the content to become adaptable in the new environments,
create experiences based on the multi-modality of inputs from the user (e.g. haptic and voice).

23. Thank you
Vika Nightingale