1. Longitudinal Study on Rapi Jesse Prabawa Gozali WING Meeting Feb 15 th 2008

2. Presentation Outline Overview of Rapi Longitudinal Study (Dec 07 − Jan 08) ◦ Motivation ◦ Methodology ◦ Findings ◦ Discussion Future Works

3. Overview of Rapi Rapi (\’r ə p ē \) ◦ From the Indonesian word meaning tidy, organized or presentable ◦ A rich Open Public Access Catalog (OPAC) Four key features: ◦ Dual pane: overview + details ◦ Customizable results table ◦ Tabs ◦ Embedded suggestion bar Available at http://linc.comp.nus.edu.sg/http://linc.comp.nus.edu.sg/

4. Overview of Rapi

5. Presentation Outline Overview of Rapi Longitudinal Study (Dec 07 − Jan 08) ◦ Motivation ◦ Methodology ◦ Findings ◦ Discussion Future Works

6. Motivation Iterative design and test cycle:

7. Motivation SnapshotLongitudinal Novel usage patterns Changes in search behavior Feature adoptionChange over timeDiscoverabilityLearnabilityFeature adoption First-time experiences

8. Methodology Two-pronged approach ◦ User study (nine students)  Interaction logs  Questionnaires (scenario-based tasks and diary entries)  Interviews ◦ UI kiosk placed in situ  Interaction logs

9. Findings

10. Findings

11. Findings Feature adoption ◦ Number of participants using various features in the three scenarios of the first and last tasks Novel usage patterns ◦ Multi-type, multi-combination searches ◦ Parallel searches prior to relevance assessment ◦ Multi-tasking ◦ Subtask caching Changes in search behavior ◦ Parallel searches ◦ Suggestion-prone ◦ Relevance assessment More details in the paper available from CVS

12. Discussion Three proposals for a rich OPAC ◦ Centralized search environment  Tabs as the control center  Search and browse  Mixed results (e.g. type, medium)  Single page environment ◦ Context-aware filters  Advanced syntax may be un(popular|usable)  Faceted metadata may be insufficient  e.g. software version in how-to books, domain-specific keywords ◦ Context-aware suggestions  Task-centric suggestions  e.g. Macromedia Flash == Adobe Flash?, Rowling != Rowing?, Foo Bar?

13. Presentation Outline Overview of Rapi Longitudinal Study (Dec 07 − Jan 08) ◦ Motivation ◦ Methodology ◦ Findings ◦ Discussion Future Works

14. Supporting quantitative data ◦ Task completion rates ◦ Average time on task ◦ Average task error counts ◦ Average task satisfaction scores

15. Thank you Any questions?