A Resource Discovery Service for the Library of Texas Requirements, Architecture, and Interoperability Testing William E. Moen, Ph.D. Principal Investigator CNI Fall Task Force Meeting December 5, 2002 San Antonio, Texas

William E. MoenCNI Task Force Meeting -- December 5, Library of Texas A Virtual Library Reaching Across Boundaries to Extend Access to A Range of Information Resources Collection Boundaries Organizational Boundaries Format Boundaries

William E. MoenCNI Task Force Meeting -- December 5, ZLOT Project Resource discovery service Search/retrieval interface Virtual catalog TIF Board Library of Texas Resource discovery service Commercial online databases Preserving electronic government documents Training librarians TSLAC FY TXCDK FY

William E. MoenCNI Task Force Meeting -- December 5, ZLOT Project Z Implementation Component of the Library of Texas Developing a standards-based approach for the virtual library Project Focus Identifying requirements for resource discovery across library catalogs and online databases Demonstrating feasibility and utility of resource discovery tools

William E. MoenCNI Task Force Meeting -- December 5, Resource Discovery

William E. MoenCNI Task Force Meeting -- December 5, Finding & Exposing Finding: Users can find only what’s been exposed Exposing: How content is exposed determines the how and if user can find it Goal: Connect users to information Strategy: Interoperability on multiple levels Tactic: Common agreements for exposing and finding –Protocols –Syntaxes –Semantics

William E. MoenCNI Task Force Meeting -- December 5, ZLOT Components Functional Requirements Technology Inventory Assessment Proof of Concept Evaluation Service-Based Architecture Technical Requirements & Specifications

William E. MoenCNI Task Force Meeting -- December 5, Functional Requirements Key Players –Advisory Group –Focus Groups Requirements –Virtual Catalog –Search and Retrieval Interface –Search Interface –Retrieval Interface Priorities 1.Must Have 2.Should Have 3.Nice to Have Resource Discovery Service Virtual Catalog Search & Retrieval Interface

William E. MoenCNI Task Force Meeting -- December 5, Common Interface — Diverse Resources

William E. MoenCNI Task Force Meeting -- December 5, ZLOT Components Functional Requirements Proof of Concept Evaluation Service-Based Architecture Technical Requirements & Specifications Technology Inventory Assessment

William E. MoenCNI Task Force Meeting -- December 5, Texas Library Landscape Libraries: –165 academic libraries –550 public libraries Holdings: –Academic: 33,458,000 –Public: 27,466,300 Technology: –ZLOT Technology Inventory and Assessment Survey –53% response rate

William E. MoenCNI Task Force Meeting -- December 5, Technology Assessment: Z39.50 Servers

William E. MoenCNI Task Force Meeting -- December 5, Technology Assessment: Z39.50 Clients

William E. MoenCNI Task Force Meeting -- December 5, Technology Assessment: Library Websites AcademicPublicSample Have website100%62%69% Hosted in library45%40%42% Maintained by library81%70%73%

William E. MoenCNI Task Force Meeting -- December 5, Technology Assessment: Internet Access Fastest Connection

William E. MoenCNI Task Force Meeting -- December 5, ZLOT Components Functional Requirements Technology Inventory Assessment Evaluation Service-Based Architecture Technical Requirements & Specifications Proof of Concept

William E. MoenCNI Task Force Meeting -- December 5, Proof of Concept Assess feasibility of functional requirements through prototypes Examine capabilities of vendor products Identify challenges –Z39.50 access to library catalogs –Concurrent searching –Interface design Participation by 11 library technology vendors

William E. MoenCNI Task Force Meeting -- December 5, Proof of Concept: Resource Discovery Service Z39.50 Catalogs Web Catalogs TexShare Databases 4.Texas Records and Information Locator Resources Middleware Interface 1.Broadcast Searching a.Similar Resources b.Dissimilar Resources 2.Common Retrieval Display 1.Translates Searches 2.Formats Retrievals 3.Interacts with Multiple IR Systems Information Retrieval Systems 10 Vendor Prototypes

William E. MoenCNI Task Force Meeting -- December 5, ZLOT Components Functional Requirements Technology Inventory Assessment Proof of Concept Service-Based Architecture Technical Requirements & Specifications Evaluation

William E. MoenCNI Task Force Meeting -- December 5, Evaluation Evaluation plan for the Library of Texas –Goals, objectives, outcomes, and indicators for 4 LOT components Assessment of Proof of Concept prototypes –Systematic evaluation of prototypes against functional requirements –Inform Technical Requirements & Specifications

William E. MoenCNI Task Force Meeting -- December 5, Sample Results

William E. MoenCNI Task Force Meeting -- December 5, ZLOT Components Functional Requirements Technology Inventory Assessment Proof of Concept Evaluation Technical Requirements & Specifications Service-Based Architecture

William E. MoenCNI Task Force Meeting -- December 5, Service-Centric Virtual Library User Groups Resources Technology Management SERVICES

William E. MoenCNI Task Force Meeting -- December 5, User-Driven Services LIBRARY SERVICES User Group User Group User Group User Group Library Resources Library Technology

William E. MoenCNI Task Force Meeting -- December 5, Architecture PROVIDER LAYER SERVICES LAYER USER LAYER Communication Protocols

William E. MoenCNI Task Force Meeting -- December 5, Provider Layer PROVIDER LAYER Digital Content LibrarianLibrarySupplier Provider Type Dependent on VL Service Resource Discovery Service Virtual Reference Service ILL Service Document Order/Delivery Service

William E. MoenCNI Task Force Meeting -- December 5, Services Layer Standard Information Interchange Among Services Reference Financial Resource Discovery Resource Access Personalization Authentication

William E. MoenCNI Task Force Meeting -- December 5, Resource Discovery: Functional View 1.TexShare Databases 2.E-books 3.Electronic Archive of Government Information 4.Statewide Virtual Catalog Content or Resource Collections Representations of Resources 1.Proprietary Records 2.Indices of Full-text Files 3.Dublin Core Metadata Records 4.MARC Records MIDDLEWARE LOT Search & Retrieval Interface 1.Broadcast Searching a.Similar Resources b.Dissimilar Resources 2.Common Retrieval Display 1.Translates Searches 2.Formats Retrievals 3.Interacts with Multiple IR Systems Middleware Information Retrieval Systems

William E. MoenCNI Task Force Meeting -- December 5, Resource Discovery: Functions Browse Collection Selection Evaluation Query Common User Interface

William E. MoenCNI Task Force Meeting -- December 5, Resource Discovery: Architecture DIGITAL CONTENT SERVICES LAYER USER LAYER TexShareTRAILVCOthers Resource Discovery LibraryHomeOfficeMobile Personalization Authentication Z39.50 HTTP SOAP OTHER

William E. MoenCNI Task Force Meeting -- December 5, ZLOT Components Functional Requirements Technology Inventory Assessment Proof of Concept Evaluation Service-Based Architecture Technical Requirements & Specifications

William E. MoenCNI Task Force Meeting -- December 5, Technical Requirements & Specifications Refinement of functional requirements –Based on Proof of Concept experience –Formal assessment of prototypes –Vendor responses on functional requirements –Evolving understanding of the requirements Specifications of standards to improve interoperability

William E. MoenCNI Task Force Meeting -- December 5, Interoperability Factors Multiple and disparate systems Multiple protocols Multiple data formats, syntax, metadata schemes Multiple vocabularies, ontologies, disciplines Multiple languages, Multiple character sets Indexing, word normalization, and word extraction policies

William E. MoenCNI Task Force Meeting -- December 5, Z-INTEROP Testbed Z39.50 Interoperability Testbed Project A Institute of Museum and Library Services National Leadership Grant Goal: Improve Z39.50 semantic interoperability among libraries for information access and resource sharing

William E. MoenCNI Task Force Meeting -- December 5, Z-INTEROP Components Test dataset –400,000 MARC 21 records from OCLC’s WorldCat Z39.50 reference implementations –Z-client, Z-server, information retrieval system Test scenarios & searches –Searches with known result records from dataset Benchmarks –Results of test searches against reference implementations

William E. MoenCNI Task Force Meeting -- December 5, ZLOT & Z-INTEROP ZLOT resource discovery service specifies support for: –Z39.50 –Z39.50 profiles Z-INTEROP can be used to assist libraries and vendors in Z39.50 configuration and testing Improve user confidence in resource discovery service

William E. MoenCNI Task Force Meeting -- December 5, Issues Optimizing resource discovery –Concurrent / Broadcast searching performance –Z39.50 interoperability –Non-Z39.50 information providers –Static union v. dynamic virtual catalogs Users and usability –Interface design for various target audiences –Defining collection sets for searching

William E. MoenCNI Task Force Meeting -- December 5, Issues Standards and emerging technologies –XML –Web services –OpenURL –Z39.50 International: Next Generation Search / Retrieve for the Web Access control, authorization, and authentication Management for collaborative services –Governance –Policy

William E. MoenCNI Task Force Meeting -- December 5, William E. Moen LOT ZLOT Project Z-INTEROP Project Texas Center for Digital Knowledge