1. TOKEN Field Usability Study Janet An Stephany Yong Timi Opeke
Bruno De Martino

2. System being evaluated
Token lets users pin a photo or video to a location, so that those who receive it can see its location on a map, but can only access it when they are standing where the message was pinned.
Evaluating our high-fidelity Android application

3. Purpose of experiment
Understand people’s reactions to the physical component of Token (i.e. moving to the token location)
Verify if UI changes on systems were sufficient to solve the problems seen in previous user testing (e.g. difficulty opening token)
Look for more areas of improvement in our UX/UI implementation

4. Test Measures and Results
Outline of Talk
Method
Test Measures and Results
Discussion

5. Method: Participants - Lea - 20 yo - Undergrad - SymSys major - Grant
- Masters Student
- CS major
- Arina
- 18 yo
- Exchange student from Japan
- History major
- Vitaly (& Natalia)
- 20 yo
- Visitor from Ukraine
How recruited and compensated

6. Method: Apparatus Equipment Used: Android, beat up Galaxy S3
Location: Old Union, White Plaza, Tresidder

7. Method: Tasks Create and share personal content
View content shared by a friend
Engage with a location through
public content

8. Method: Task 1 Create and share personal content What we looked for:
Camera functionality
Ease in navigating through taking photo, adding caption, and tagging friend
How easy/obvious it was to share with a friend

9. Method: Task 2 View content shared by a friend What we looked for:
Ability to find the friend tokens on the map
Ability to move towards friend token to open it
Observe if participants interaction with photo was positive
Ability to navigate back to the map

10. Method: Task 3 Engage with a location through public content
What we looked for:
Ability to locate public pins on the map
Ability to move towards public token to open it
Ease in understanding and interacting with upvote/downvote buttons

11. Method: Procedure Bruno read introduction from prepared script
Timi explained each task to the participants
Stephany took photos
Janet timed each participant
Bruno took notes
Janet asked the volunteers to tell us about their experience after the 3 tasks were completed
After each user left, the team discussed and analyzed what happened

12. Test Measures The time taken to perform each task
The number of taps required to finish each task
Similarities and differences among the different users

13. Results: Time Comparison
Create content
View friend token
View public token
Lea
1:24
1:03
1:14
Grant
3:04
2:22
0:22
Arina
2:02
3:55
Vitali (& Natalia)
5:24
Not completed
3:44

14. Results: Tap Comparison
Create content
View friend token
View public token
Lea 10 4
Grant 15 3 5
Arina 14
Vitali (& Natalia) 28
Not completed 16

15. Results: Would you use it?
“I would use it!”
“No, I don’t really like social sharing apps”
“Yes! This is so much fun!”
“Of course!! This is the most amazing thing I have ever seen in my life”

16. Results: User Quotes “Wow, I really like this. It’s really seamless”
“Damn, this is actually pretty good!”
“This is so much fun!” (said while user was walking to a token)
“Hmm… Yeah, I don’t know if I want to walk all the way over there to see this [photo]”

17. Discussion: What we learned
When creating a token, people have difficulty leaving the keyboard (particularly non-Android users)
Users will not intuitively go to the hardware: Back button to navigate to map screen was missed by all four testers
Geolocation has some lag problems
People wanted to know which tokens they had visited already
Some expected to go to home screen after going through “First User” slideshow
Participants wanted the opening radius to be more clear

18. Discussion: Difficulties of running in situ
Challenges in establishing correct proximity radius in determining if a user can access a token.
Question: What is the soft spot between a piece of content being too easy to access (effectively eliminating the novelty of being there to see a photo) versus it being a hassle for the user to be standing at the exact spot to open a token?

19. Discussion: What we’ll change
Scrolling page when keyboard is up
Gray out tokens that have been visited already
Take users directly to home page after tutorial
Fix camera bugs (right now, it arbitrarily does not save photos sometimes)
Make the person’s position on the map bigger
Improve all ‘forward’ oriented workflow actions (Progressing through Task 1: Take photo, add caption, share photo, post token) through obvious buttons with clear calls to action

20. Summary
This was a valuable and rewarding experience in finally testing Token with users
Encouraging Takeaway: Test subjects seemed, if anything, very intrigued by the novelty of a location-based content sharing application
Going forward, we will:
Focus on making certain features more obvious (people missing the functionality of the filters)
Test further on getting the radius “sweet spot” for viewing a token
Perfect workflow issues, eliminating all dependencies on hardware buttons

21. Any Questions?