1. Computer Science, University College Cork, Ireland A Reporting Framework for Search Session Evaluation Cathal Hoare Humphrey Sorensen

2. Vade Mecum Latin, go with me A book for ready reference Something regularly carried about by a person “Purple flower” - location: out on a walk

3. Exploratory search From Ryen White’s Exploratory Search: Beyond the Query Response Paradigm

4. Example: Aid Exploratory Browsing Query-by-Image Provides starting point for users seeking information about a place Issues: Users are not familiar with their surroundings and may not have ontology to form productive queries. Users’ curiosity is serendipitous. How long can they spend searching?

5. Information Foraging Theory - Charnov’s Marginal Value Theorem Supporting Enrichment Find relevant information faster Find ‘informative information’

6. Support triage in information exploration Contextual Memory Aide Support users that want to explore on mobile devices Issues: Small screen size Solution: Integrate recording of interesting results and add ability to use them to inform other queries

7. Support triage in information exploration Contextual Memory Aide Support users that want to explore on mobile devices Issues: Small screen size Solution: Integrate recording of interesting results and add ability to use them to inform other queries

8. How do we know when it works?

9. Data Gathering ❖ Quantitive and Qualitative ❖ User Surveys for opinions and feedback ❖ Collect user actions to understand how interface features are used ❖ Structured experiments in naturalistic settings ❖ Google Analytics used to collect actions before being combined with framework resources to produce report

10. Evaluating a mobile application ❖ When evaluating search-while-mobile ❖ Recruitment ❖ Do they use one of our phones? (we must trust) ❖ Do we install on their phone? (they must trust) ❖ Logistics - will there be someone in the area to assist? What about the weather? ❖ Recruitment - how to find users that are suitable? ❖ Challenge of creating realistic tasks and data?

11. Modelling Process Recognise/ Accept (Re)Define Select Source Formulate Query Execute Examine Extract Reflect/ Stop

12. Modelling Process From Prof. Marchionini’s Information Seeking in Electronic Environments (1995)

13. Modelling Process

15. Architecture

16. Reporting Interface User Segmentation User Gain Playback Controls Animated Process Model

17. Conclusions ❖ There is a need to understand how mobile search is conducted - we may be surprised ❖ Mobile search user interface evaluation presents both familiar and new challenges ❖ We must understand how users use our solutions and develop iteratively with less guess work

18. Thank You

19. Ádh mór