1. ETANA-DL Managing complex information applications: An archaeology digital library This research is funded in part by NSF-ITR grant #IIS-0325579 Edward A. Fox, Virginia Tech James W. Flanagan, Case Western Reserve University ASOR Annual Meeting, Atlanta November 21, 2003

2. Acknowledgements Karen Borstad, MPP Douglas Clark, Walla Walla College Joanne Eustis, CWRU Weiguo Fan, Virginia Tech Nick Fischio, CWRU Paul Gherman, Vanderbilt U. Marcos Goncalves, Virginia Tech Larry Herr, Canadian University College Christopher Holland, LRP Paul Jacobs, Mississippi State U. Douglas Knight, Vanderbilt U. Stan LaBianca, Andrews U. Ming Luo, Virginia Tech David McCreery, Willamette U. Unni Ravindranathan, Virginia Tech Jack Sasson, Vanderbilt U. Rao Shen, Virginia Tech Ricardo Torres, U. Campinas, Brazil Randall Younker, Andrews U.

3. Overview An Archaeology Digital Library (DL) ETANA-DL Architecture Digital Libraries, 5S Framework -> Structures Open Archives Initiative, Open Digital Libraries Canned Demonstration Conclusions Discussion: Archaeology DL Requirements

4. NSF ITR Funding IT Research Digital library: Integration of DB, HCI, HT, IR, LIS, MM, … Complexity! Variety! Distributed! => 5S Framework + OAI / ODL Archaeology Research Multiple sites Multiple kinds of artifacts Multiple terminologies General/special services Multiple views Hypothesis testing Rapid publication

5. Map courtesy: www.enchantedlearning.com Current ETANA-DL Member Locations Virginia Tech Mississippi State University Vanderbilt University Canadian University College Walla Walla College Andrews University CWRU Willamette University

6. ETANA Website

7. Lahav Website

8. Nimrin Website

9. Umayri/MPP Website

10. ETANA-DL Website

11. Overview An Archaeology Digital Library (DL) ETANA-DL Architecture Digital Libraries, 5S Framework -> Structures Open Archives Initiative, Open Digital Libraries Canned Demonstration Conclusions Discussion: Archaeology DL Requirements

12. ETANA-DL Architecture UsersServicesData ETANA-DL Union ServicesUsers DigKitDigBase

13. ETANA Digital Library Core Components - DigKit DigKit (DK) Tools for collecting and recording archaeological data in the field Metadata will migrate to DigBase (DB) Real-time collaborative archaeology: metadata in DB will be rapidly available to others

14. ETANA Digital Library Core Components - DigBase DigBase (DB) Central repository - stores metadata Union catalog - for collections that are in ETANA-DL Various kinds of digital objects – excavation records, images, text collections, etc. General services - Search, Browse, Annotate, Recommend, etc. Archaeology-specific services - artifact analysis, visualizations, artifact interpretation, workflows, etc.

15. ETANA-DL Architecture DigBase and DigKit Lahav Nimrin Umayri Hisban Megiddo Jalul New Sites DATABASEWRAPPERSDATABASEWRAPPERS ETANA-DL UNION CATALOG Search USERINTERFACEUSERINTERFACE Browse Recommend Note Personalize Review Visualizations Archaeology Specific DigKitDigBase Work in progress …

16. Overview An Archaeology Digital Library (DL) ETANA-DL Architecture Digital Libraries, 5S Framework -> Structures Open Archives Initiative, Open Digital Libraries Canned Demonstration Conclusions Discussion: Archaeology DL Requirements

17. Content Types Text Documents Articles, Reports, Books Video Audio Speech, Music Geographic Information (Aerial) Photos Software, Programs Models Simulations Bio Information Genome Human, animal, plant Images and Graphics 2D, 3D, VR, CAT Digital Library Content

18. Computing (flops) - e.g., VT’s Terascale Computing Facility, 10 teraflops - 3 rd fastest in world Digital Content Communicat i ons (bandwidth, connectivity) Digital Libraries in Computing and Communications Technology Space Digital Libraries technology trajectory: intellectual access to globally distributed information lessmore

19. 5S Model - Informally Digital libraries are complex information systems that: help satisfy info needs of users (societies) provide info services (scenarios) organize info in usable ways (structures) present info in usable ways (spaces) communicate info with users (streams)

20. 5S in Archaeology - Structures Streams Structures Spaces Scenarios Societies 5S Regions Example: Madaba Plains

21. 5S in Archaeology – Structures (contd.) REGION*PARTITION*SUB-PARTITION *LOCUS *CONTAINER *FIND *SITE has subdivided has contains Lahav Nimrin Umayri Lahav:Field Nimrin:Quad Umayri:Field Lahav:Area Nimrin:Quad Umayri:Square Bone Pottery Seed Figurine Lahav:Basket Nimrin:Bag Umayri:Pail Below, Above, Co-existing *Specific- FINDing Human Mandible … planned

22. SitePartitionSub- partition LocusContainer LahavField I Area A8 Locus A8074 Basket 224 NimrinQuadrant NW Quadrant Value N25/W50 Locus 96 Bag 240 UmayriField A Square 7J59 Locus 001 Pail 12 5S Structural Model Organization

23. Data Organization in ETANA-DL Bone Seed Figurine ETANA-DL Object Count Animal …… Species Name …… Description Dimensions …… Owner Subpartition Partition Locus ID Container Collection ……

24. Database Representation QUADNW/EWLocusAnimalBone NWN40/W25178SHEEP/GOATMETAPODIAL SWS40/W1701HOMO SAPIENS- NEN50/E50-UNIDENTIFIED …..

25. A Sample Bone Record in XML 1 Nimrin Bone jwf2@cwru.edu NW N40/W25 178 212 IRON II 900-800 BC METAPODIAL SHEEP/GOAT ……

26. Overview An Archaeology Digital Library (DL) ETANA-DL Architecture Digital Libraries, 5S Framework -> Structures Open Archives Initiative, Open Digital Libraries Canned Demonstration Conclusions Discussion: Archaeology DL Requirements

27. Open Archives Initiative OAI www.openarchives.org

28. Discovery Current Awareness Preservation Service Providers Data Providers Metadata harvesting The World According to OAI

29. Some OAI Data Providers Analytical Sciences Digital Library California Digital Library Repository Caltech Archives Oral Histories Online Carnegie Mellon U Informedia Public Domain Video Archive DSpace at MIT Library of Congress Open Archive Initiative Repository Perseus Digital Library The University of Michigan Library The University of Tennessee Library University of Illinois Library U of Pittsburgh Electronic Thesis and Dissertation Archive Virginia Tech ImageBase

30. repository repositoryrepository OAI protocol harvesterharvester support data harvesting data items

31. selective harvesting - datestamps repositoryrepository harvest within date range record

32. Data and Service Providers Data Providers possess metadata and share it (internally / externally) via well-defined OAI protocols (e.g., database servers) Service Providers harvest data from Data Providers provide higher-level services to users (e.g., search engines) Who will fit where in ETANA-DL? Data Provider – YOUR PROJECT Service Provider – ETANA-DL

33. What then is an Open Archive? Any WWW-based system accessed through the well-defined interface of Open Archives Protocol for Metadata Harvesting Also known as OAI-Compliant Repository No implications for: Physical storage of data Cost of data Metadata and data formats Access control to server Will my current digital system be affected? NO An Open Archive is built separately without disturbing the data or the current system

34. Introduction to ODL (Open Digital Libraries) Open Digital Libraries Framework for componentized Digital Libraries Design principles for components Protocols for inter-component communications Built upon OAI

35. Traditional Digital Libraries ? 1010100101 0100101010 1001010101 0101010101 Program 1010100101 0100101010 1001010101 0101010101 Document 1010100101 0100101010 1001010101 0101010101 Document 1010100101 0100101010 1001010101 0101010101 Document 1010100101 0100101010 1001010101 0101010101 Program 1010100101 0100101010 1001010101 0101010101 Program 1010100101 0100101010 1001010101 0101010101 Image 1010100101 0100101010 1001010101 0101010101 Image 1010100101 0100101010 1001010101 0101010101 Image 1010100101 0100101010 1001010101 0101010101 Video 1010100101 0100101010 1001010101 0101010101 Video 1010100101 0100101010 1001010101 0101010101 Video ? Monolithic and/or Custom-built web-based application UsersDigital Library Digital Objects

36. Open Digital Libraries Approach UsersETANA-DLSites 1010100101 0100101010 1001010101 0101010101 Bone Search Filter Union Recent Browse USER INTERFACE Filter 1010100101 0100101010 1001010101 0101010101 Seed 1010100101 0100101010 1001010101 0101010101 Figurine 1010100101 0100101010 1001010101 0101010101 Pottery

37. Basic ODL Model: An application for Archaeology OAI Data Provider OAI-PMH ODL Protocol User Interface Nimrin ETANA-DL Union Catalog OAI-PMH ETANA-DL Search Engine ODL Service Provider Component WWW Interface ODL Protocol

38. Overview An Archaeology Digital Library (DL) ETANA-DL Architecture Digital Libraries, 5S Framework -> Structures Open Archives Initiative, Open Digital Libraries Canned Demonstration Conclusions Discussion: Archaeology DL Requirements

39. Home Page

40. Login Page New Account

41. New Account Creation Page

42. Navigations ETANA-DL Tutorial Collections Description Items of Interest, Marked Items, Browse, Search, etc.

43. Collections Description Page More information about the site

44. Search Results Links to result pages Objects belonging to site: Lahav, area:G6, and locus:G6006 Objects belonging to site: Lahav and Area:K7 Search Query / Number of Hits

45. Detailed Display (Lahav Figurine) From Lahav data collection Lahav Terms Field Area Locus Basket

46. Detailed Display (Nimrin Seed) Nimrin Terms Quad Quadrant Locus Bag

47. Detailed Display (Umayri Bone)* *Data Integration in progress Umayri Terms Field Square Locus Pail …..

48. Advanced Search Page

49. SitePartitionSub-partitionLocusContainer LahavField I Area A8 Locus A8074 Basket 224 NimrinQuadrant NW Quadrant Value N25/W50 Locus 96 Bag 240 UmayriField A Square 7J59 Locus 001 Pail 12 5S Structural Model Organization

50. Advanced Search Options Example

51. Search Results Query

52. Browsing Fields in Umayri’s bone collection

53. Browsing - II Squares in Field ‘H’ Records in Field ‘H’ for Umayri

54. Adding to Items of Interest Add item to personal collection

55. Items of Interest Display Objects user is interested

56. Marking an Item Mark Items

57. Marking – writing notes for a specific user Marking Items

58. Marked Items Display Sender, Date, Object OAI ID Sender Comments Options: View Record, Add record to Items Of Interest, Re-mark item (Redirect), Unmark item (Remove item from list)

59. Discussions Page Discussions about an object View/Post messages, create new threads

60. Recommendations Items recommended on the basis of similar interests

61. Overview An Archaeology Digital Library (DL) ETANA-DL Architecture Digital Libraries, 5S Framework -> Structures Open Archives Initiative, Open Digital Libraries Canned Demonstration Conclusions Discussion: Archaeology DL Requirements

62. Conclusions ETANA-DL: integrated services built upon many archaeology projects Harvesting (, OAI, ODL) 5S Framework: Model, Tailored Generation Links for more information Welcome collaboration!

64. Harvesting vs. Federation Competing approaches to interoperability Federation is when services are run remotely on remote data (e.g., Meta-searching) Harvesting is when data/metadata is transferred from the remote source to the destination where the services are located (e.g. Union catalogues) Federation requires more effort at each remote source but is easier for the local system and vice versa for harvesting OAI currently focuses on harvesting

65. 5S Model ModelsExamplesObjectives Stream Text; video; audio; imageDescribes properties of the DL content such as encoding and language for textual material or particular forms of multimedia data Structures Collection; catalog; hypertext; document; metadata; organization tools Specifies organizational aspects of the DL content Spaces Measure; measurable, topological, vector, probabilistic Defines logical and presentational views of several DL components Scenarios Searching, browsing, recommending,Details the behavior of DL services Societies Service managers, learners, Teachers, etc. Defines managers, responsible for running DL services; actors, that use those services; and relationships among them

66. 5SLGen: Automatic Digital Library Generation

67. Links to Resources ETANA Home Page http://www.etana.org http://www.etana.org ETANA-DL Home Page http://feathers.dlib.vt.edu http://feathers.dlib.vt.edu ETANA-DL Prototype http://feathers.dlib.vt.edu:8080/etana/servlet/Start http://feathers.dlib.vt.edu:8080/etana/servlet/Start Proposal submitted to NSF-ITR http://feathers.dlib.vt.edu/ETANAProposal.pdf http://feathers.dlib.vt.edu/ETANAProposal.pdf Open Archives Initiative http://www.openarchives.org http://www.openarchives.org OAI Metadata Harvesting Protocol http://www.openarchives.org/OAI/openarchivesprotocol.htm http://www.openarchives.org/OAI/openarchivesprotocol.htm Virginia Tech DLRL Projects http://www.dlib.vt.edu/ http://www.dlib.vt.edu/

68. Overview An Archaeology Digital Library (DL) ETANA-DL Architecture Digital Libraries, 5S Framework -> Structures Open Archives Initiative, Open Digital Libraries Canned Demonstration Conclusions Discussion: Archaeology DL Requirements