ETANA-DL NSF Digital Library Project Edward A. Fox, Virginia Tech ASOR Annual Meeting,

Problems Delay in publication of primary archaeological data Lack of sustainable solutions to long-term preservation of valuable information Lack of services useful to the archaeology community, including “traditional DL services” Difficulty in understanding complex archaeological information systems Difficulty in requirements elicitation for archaeological systems Interoperability among heterogeneous archaeological systems

Solution – our approach Applying and extending Digital Library (DL) techniques to solve the following problems: making primary data available, data preservation, and interoperability Modeling archaeological information systems using 5S theory to better understand the domain and design the system and the supported services Rapidly prototyping DLs that handle heterogeneous archaeological data using componentized frameworks: elicitating requirements, providing useful services

ETANA-DL Archaeological Digital Library Applies and extends the OAI-PMH Open Archives Initiative Protocol for Metadata Handling Design considerations Componentized Distributed architecture Extensible Portable

SiteArtifact TypeOriginal data source Number of records harvested Bab edh-Dhra’Potterycp6 database file786 LahavFigurineTab-delimited text file563 MadabaLocus field recordTables in Access DB786 MozanPublicationPDF files19 Nimrin Bone field recordTable in Oracle DB7419 Seed field recordTable in Oracle DB429 Locus field recordTable in Oracle DB2101 UmayriBone field record2 tables in Access DB2122 Total18404 Heterogeneous data handling

ETANA-DL Searching Service Search

ETANA-DL Multi-dimensional Browsing 3 new sites 2 new types of artifacts

ETANA-DL Visual Browsing Service Visual Browse By site

Visual Browsing Nimrin: Topographical Drawings Full siteNorth west quadrant Square: N40/W20

Visual Browsing Nimrin : Square information Square: N40/W20 Locus: 86 Loci layout

Visual Browsing Nimrin : locus sheet

Visual Browsing Bab edh-Dhra' Cemetery Pottery # 25

Visual Browsing Bab edh-Dhra' Cemetery Pottery # 25

5S Archaeological DL Modeling Modeling archaeological information systems using the 5S theory to better understand the domain and design the system and the supported services

Digital Object Repository Collection Minimal DL Metadata Catalog Descriptive Metadata Specification A Minimal DL in the 5S Framework Structural Metadata Specification StreamsStructuresSpacesScenariosSocieties indexing browsing searching services hypertext Structured Stream

StreamsStructuresSpacesScenariosSocieties indexing browsing searching services hypertext Structured Stream Descriptive Metadata specification SpaTemOrg StraDia Arch Descriptive Metadata specification ArchDO ArchObj ArchColl Arch Metadata catalog ArchDColl ArchDR Minimal ArchDL A Minimal ArchDL in the 5S Framework

Modeling ETANA-DL – An Archaeological DL Meta-model Text Video Audio *Site *Sub-partition *Container*Artifact*LocusRegion Taxonomies Temporal Artifact-specific Space model Structure model Metadata DrawingPhoto3D Stream model *Partition Society model Archaeologist General public Geographic space Service Manager Information Satisfaction Value added Repository building Scenario model Services Domain specific User interfaceMetric space Spatial

Modeling ETANA-DL – ETANA Model *Field*Pail *Bone *LocusJordan Taxonomies Space model Structure model Field record, locus sheet Figurine image (photo) Stream model Umayri Society model Archaeologist Generic public Site-specific coordinate system Web interface Vector space ETANA-DL Service Manager Searching, Browsing Annotation, binding Harvesting, Converting Scenario model Services Object comparison, marking item for analysis Archaeological periods Bone type Seed species *Square *Figurine *Quadrant*Bag *Locus Jordan Valley Nimrin *Square *Field*Basket*LocusSouthern IsraelHalif*Area *Seed Site/field plan (drawing) Preliminary/Final Report (application/pdf) Spatial

Overall objective of 5SGraph: Help users model their own instances of a digital library (DL) in the 5S language (5SL). A simple modeling process which enables rapid generation of digital libraries is needed.  Support non-expert users.  Speed-up development process.  Increase the quality of final product. 5SGraph: A DL Modeling Tool

Goals of 5SGraph To help digital library designers understand the 5S model quickly and easily To help digital library designers build their own digital libraries without difficulty To help digital library designers transform their models into 5SL files automatically To help digital library designers understand, maintain, and upgrade existing digital library models conveniently

5SGraph How does 5SGraph work? 5SGraph loads and displays a metamodel in a structured toolbox. The structured editor of 5SGraph provides a top-down visual environment for the DL designer. 5SGraph produces correct 5SL files according to the visual model built by the designer.

Overview of 5SGraph Workspace (instance model) Structured toolbox (metamodel)

Stream Model

Structure Model

Space Model

Scenario Model

Society Model

Component Reuse Components can be loaded/saved.  Load and save sub-trees Component reuse saves time and effort.  Full reuse from component pool  Partial reuse: adapting components

Semantic Constraints There are inherent semantic constraints in the hierarchical structure of the 5S model. 5SGraph maintains the constraints and enforces these constraints over the instance model to ensure correctness.

Discovery Current Awareness Preservation Service Providers Data Providers Metadata harvesting The World According to OAI

Data and Service Providers Data Providers  possess metadata and share it (internally / externally)  via well-defined OAI protocols (e.g., database servers) Service Providers  harvest data from Data Providers  provide higher-level services to users  (e.g., search engines) Who will fit where in ETANA-DL?  Data Provider – YOUR PROJECT  Service Provider – ETANA-DL

Why be an OAI Provider Speed up publication Long-term preservation Do not need to worry about providing services

How to be an OAI Provider Requirements Perl Web server with ability to run CGI scripts Download OAI-XMLFile-2.1.tar.gz fromOAI-XMLFile-2.1.tar.gz le.html Extract the files into a directory from which CGI scripts may be run gunzip OAI-XMLFile-2.1.tar.gz tar –xvf OAI-XMLFile-2.1.tar

How to be an OAI Provider (Cont.) Want your pottery collection be an OAI data provider? Create a director “mySitePottery” under ‘OAI-XMLFile- 2.1/XMLFile’ Copy the contents in test5 directory to “mySitePottery” directory Modify the config.xml under ‘OAI-XMLFile- 2.1/XMLFile/mySitePottery’

… pottery repository name pottery Archive ID 500 directory of pottery XML collection … prefix of pottery repository namespace of your schema location of your XML file schema

Apply the 5S Framework in Integrating Archaeological DLs Architecture of a Union DL Union Catalog Integration Union Services Automation

Repository1 DL1 Repository2 Union Catalog Union Repository Catalog1Catalog2 Searching Union DLDL2 archaeologists Society General Public Society Archaeologists General Public Union Society Service Browsing Service Union Service Harvesting, Mapping, Searching, Browsing, Clustering, Visualization Architecture of a Union DL

Union Catalog VN Catalog Union Catalog Integration Virtual Nimrin (VN) Halif DigMaster (HD) HD Catalog VN Metadata Format Mapping Tool Mapping Tool Global Metadata Format Wrapper HD Metadata Format

Visualizing Components Mapper1 Composite Mapper Mapper2Mapper3Mapper4 Visual Mapping Tool Architecture

local schemaglobal schema

Mapping recommendation

Mapping confirmationMapping history

No recommendation for “Tomb_Area”

User-decided mapping

5S Meta Model 5SGraph DL Expert DL Designer 5SL DL Model 5SLGen Practitioner Researcher Tailored DL Services Teacher c omponent pool ODLSearch, ODLBrowse, ODLRate, ODLReview, ……. Requirements (1) Analysis (2) Implementation (4) Design (3) 5SGraph5SGen Mapping Tool 5SSuite

5SGraph 5S Archaeology MetaModel ArchDL Expert ArchDL Designer VN Metadata Format ETANA-DL Metadata Format Mapping Tool Wrapper4VNWrapper4HD HD Metadata Format Inverted Files Services DB Index Browse Service Search Service Browse DB Other ETANA-DL Services Web Interface XOAI VN Catalog VN Catalog Union Catalog Structure Sub-model Scenario Sub-model Harvesting description Mapping description Browsing description … 5SGen Component Pool Browsing …