1. Exploring Digital Libraries: Integrating Browsing, Searching, and Visualization JCDL 2006, Chapel Hill, NC, June 12, 2006 Rao Shen, Naga Srinivas Vemuri, Weiguo Fan, Ricardo da S. Torres, and Edward A. Fox fox@vt.edu http://fox.cs.vt.edu

2. Acknowledgements (Selected) Sponsors: NSF grant ITR-0325579, ASOR, CWRU, ETANA, Vanderbilt U., Virginia Tech Faculty/Staff: Lillian Cassel, Debra Dudley, Manuel Perez, … VT (Former) Students: Marcos A. Gonçalves, Doug Gorton, Aaron Krowne, Ming Luo, …

3. Acknowledgements (Selected) Karen Borstad, MPP Giorgio Buccellati, UCLA Douglas Clark, Walla Walla College Joanne Eustis, CWRU Nick Fischio, CWRU Israel Finkelstein, Tel-Aviv University Paul Gherman, Vanderbilt U. Andrew Graham, U. Toronto Tim Harrison, U. Toronto Larry Herr, Canadian University College Christopher Holland, LRP Paul Jacobs, Mississippi State U. Douglas Knight, Vanderbilt U. Stan LaBianca, Andrews U. David McCreery, Willamette U. Eric Meyers, Duke U. Adam Porter, Illinois College Jack Sasson, Vanderbilt U. Tom Schaub, Indiana U. of Penn. Randall Younker, Andrews U.

4. Outline  Introduction  Related work  Exploring service formalization  Exploring services in ETANA-DL  Conclusions

5. Introduction What’s exploring? searching, browsing, investigating, studying, or analyzing for purposes of discovery, pursuing truth or facts about something

6. Introduction (Cont.) Are browsing and searching duals or can they be converted to each other when certain conditions are met? Can we generalize these DL exploring services within a formal DL framework? Can the formal generalization guide development of exploring services for domain focused DLs?

7. Related Work on Integrating Services in DLs has an example I3RI3R systems In 1980s found in RABBIT integrating searching and browsing systems In 1990s systems In 2000s CODER DataWeb has an example PESTOSenseMaker has an example MIXScentTrailsBBQ ODLMARIAN integrating searching and browsing with other services clustering and visualization has examples Stepping Stones & Pathways CitiViz includes Cat-a-Cone WebBookHieraxes RB++Grouper EtanaViz … KartooFlamenco

8. Within the 5S Framework Generalize DL exploring services such as browsing, searching, clustering, and visualization. Prove theorems and lemmas based on the generalization searching browsing Exploring Services Formalization

9. Exploration Space (Espa) is a Space Espa=(Q, Contents, OP_Set) Q is a set of conceptual representations for user information needs Contents: associated with collection C OP_Set is a set of operations on Q and Contents {OP viz, OP clu, OP s, OP b } OP_Set Exploring Services Formalization (Cont.)

10. Sample OP_Set: {OP viz, OP clu, OP s, OP b } OP viz : maps a set of digital objects to a visual mark OP clu : gets similarity of a pair of subsets of collection and their associated contents OP s : associates a query with a digital object and its contents OP b : associates a traverse link with contents of the target node (i.e., follows a hypertext link) Exploring Services Formalization (Cont.)

11. An Exploring Service (Eser) is a set of scenarios over an exploration space (Espa). Eser=(sc 1, sc 2, …, sc i, …, sc n ), where sc i is a sequence of events each event is associated with one or more of the operations in Espa Exploring Services Formalization (Cont.)

12. … … eiei OP_Set Searching: Op s Browsing: Op b Clustering: Op clu Visualization: Op viz … State Diagram Exploring Services Formalization (Cont.)

13. Theorems and LemmasSearching Op s Browsing Op b Clustering Op clu Visualization Op viz Theorem 1  Theorem 2  Theorem 3 (Op s followed by Op clu )  Theorem 4 (Op s followed by Op viz )  Lemma 1  Lemma 2  Lemma 3 (Op b followed by Op s )  Lemma 4 (Op s followed by Op b )  Theorems & Lemmas related to Operations

14. Outline  Introduction  Related work  Exploring service formalization  Exploring services in ETANA-DL  Conclusions

15. Theory-based approach to describing DL Exploring Services — guides us to design and implement exploring services for ETANA-DL Multi-dimensional browsing Searching and browsing integration Visualization Usability evaluation

16. Exploring Service in ETANA-DL —Multi-dimensional Browsing Tomb # 056 in Area A of Bab edh-Dhra

17. Tomb #056 in Area A of Bab edh-Dhra, Time Period: EARLY BRONZE III View Records

18. browsing service searching service navigation path query Exploring Service in ETANA-DL —Multi-dimensional Browsing

19. Tomb #056 in Area A of Bab edh-Dhra, Time Period: EARLY BRONZE III Save navigation path Go to saved navigation paths

20. View Records

21. Searching and Browsing Integration Search Saucer Records within the Context

22. 12 saucer records in tomb #056 in area A of Bab edh-Dhra'

23. retrieve 88 equus records through basic search organize searching results

24. Organize searching results into 3 dimensions

25. View Records

26. EtanaViz: Initial Interface Query: bone records from Nimrin

27. EtanaViz: Bone records from Nimrin

28. EtanaViz: Total Number of Animal Bones across Nimrin Culture Phrases

29. EtanaViz: Percentages of Animal Bones across Nimrin Culture Phrases

30. BrowseSearchEtanaViz Save navigation path (SNP) Search within browsing context (SWBC) 4.0 4.5 Impression about ETANA-DL services

31. Average time on tasks without outlier

32. Outline  Introduction  Related work  Exploring service formalization  Exploring services in ETANA-DL  Conclusions

33. Conclusions  Approach DL exploring services based on a DL theory.  Develop theorems indicating browsing and searching can be converted and switched to each other under certain conditions.  Provide a systematic and functional method to design and implement DL exploring services in an integrated archaeological DL, ETANA-DL, which was used as a case study.  Made contributions to aid both users and developers of DLs.

34. Questions? Comments?

35. 5Ss SsExamplesObjectives Streams Text; video; audio; image Describes properties of the DL content such as encoding and language for textual material or particular forms of multimedia data Structures Collection; catalog; hypertext; document; metadata Specifies organizational aspects of the DL content Spaces Measure; measurable, topological, vector, probabilistic Defines logical and presentational views of several DL components Scenarios Searching, browsing, recommending Details the behavior of DL services Societies Service managers, learners, teachers, etc. Defines managers, responsible for running DL services; actors, that use those services; and relationships among them

36. Theorem 1: Searching service … … eiei OP_Set Searching: Op s query i searching results for query i State Diagram

37. Theorem 2: Browsing service … … eiei OP_Set Browsing: Op b Contents of the target node State Diagram

38. Theorem 3: Post retrieval clustering service … … eiei OP_Set Searching: Op s Clustering: Op clu clusters of searching results searching results for query i 1 2 3 query i State Diagram

39. Lemma 1: Searching Browsing query 0 query 1 query i … … … … Results πiπi Q search Л

40. Lemma 2: Searching Browsing query 0 query 1 query i … … … … results πiπi Q search Л query i = OP s -1 (results) π i = OP b -1 (results) query i = π i

41. Lemma 3: switch from browsing to searching special case: query refinement/expansion … … π iπ i Л query 0 query 1 query i … … query i+1 5 Contents postBrowse browsing results associated with navigation path π i 12 Q postBrowse 3 4

42. Lemma 4: switch from searching to browsing OP_Set searching results for query v1v2…vi…v1v2…vi… Searching: Op s Clustering: Op clu Contents of cluster 1 Contents of cluster 2 … Contents of cluster i … 3 5 2 4 … … eiei query i v0v0 π0π0 π2π2 πiπi 1 State Diagram

43. Theorem 4: Post retrieval visualization service … … eiei OP_Set Searching: Op s Visualization: Op viz Visual marks in a spatial substrate searching results for query i 1 2 3 query i State Diagram