Leaving Black Boxes Behind benefits and challenges of running in-house developed e-resource management and discovery systems Evelyn Weiser Annika Domin Leipzig University Library 2016/06/08 ELAG 2016 | Copenhagen

Outline finc amsl index administration interface 1. project finc open source discovery and commercial aggregated index 2. project amsl open source electronic resource management 3. aggregated index renewal or do-it-yourself? 4. aggregated index building our own 5. synergy effects index administration with amsl Part 1: Projects and Background Part 2: A Metadata Source’s Lifecycle

Outline Part 1: Projects and Background Part 2: A Metadata Source’s Lifecycle Contract NegotiationLicensing RequestEvaluationTechnical ImplementationSelectionProcessing and UpdateCatalogue 1. Licensing Request 2. Contract Negotiation 3. Evaluation 4. Technical Implementation 5. Selection 6. Processing and Update 7. Catalogue

Part 1: Projects and Background

finc amsl index administration interface : Project finc development of resource discovery systems based on VuFind for 11 university libraries in Saxony integration of heterogeneous data sources as well as Ex Libris’ Primo Central index first finc catalogue went live in March 2012 establishment of the finc user community in September 2015

finc amsl index administration interface development of an electronic resource management system based on the editor OntoWiki and linked data technologies management of contracts, licences, holdings, contact details in RDF integration of external bibliographic and organisation data amsl went into live operation in 4th quarter of contd : Project amsl

finc amsl index administration interface licence for Primo Central was to expire mid-2015 evaluation of the index led to the question: Is it possible, with moderate expense and with no qualitative or quantitative restrictions, to build an aggregated index on our own? 2014 : Reconsidering the aggregated index

finc amsl index administration interface motivation and goal: greater transparency and more options for action ●sources ●quality ●indexing ●processes ●currentness ●coverage 2014 : Reconsidering the aggregated index

finc amsl index administration interface Q3 / Q evaluation of available metadata sources, preliminary talks with providers January 2015 decision to build our own aggregated index Q1 / Q2 2015technical realisation April 2015 go live 2014 contd : Project finc AI - aggregated index

finc amsl index administration interface 2016 : Index administration using amsl 20 participating libraries 70 metadata sources 5000 collections ⇒ complex administration ⇒ amsl as management backend for the index

Part 2: A Metadata Source’s Lifecycle

Licensing Request Documentation of potential metadata sources in amsl from the very beginning. Licensing Request

Metadata usage terms need to be included into the licensing agreement. Contract Negotiation Taken from Licensing Request

A metadata test set needs to be evaluated both bibliographically and technically. Evaluation Contract NegotiationEvaluationLicensing Request

The individual download and normalization routines need to be implemented. Technical Implementation Contract NegotiationEvaluationTechnical ImplementationLicensing Request

Contract NegotiationEvaluationTechnical Implementation metadata in processing format download and normalization Technical Implementation XML/DC XML/propr. JSON/ JATS XML/ JATS OAIHTTPFTPDVD Provider JSON/ DC CSV/ propr. The individual download and normalization routines need to be implemented. Licensing Request

Selection Contract NegotiationEvaluationTechnical ImplementationSelection Participating libraries can select the collections they want to display in their catalogue frontends. Licensing Request

The metadata is processed for the aggregated index update. Processing and Update Contract NegotiationEvaluationTechnical ImplementationSelectionProcessing and UpdateLicensing Request

Processing and Update Contract NegotiationEvaluationTechnical Implementation Provider holdings files metadata in processing format amsl solr metadata + licensing information web catalogue download and normalization enrichment with library and licensing information conversion to solr format SelectionProcessing and UpdateLicensing Request

The new metadata is available in the web catalogue. Catalogue Contract NegotiationEvaluationTechnical ImplementationSelectionProcessing and UpdateCatalogueLicensing Request

Conclusion: Benefits and Challenges

! Challenges increased staff requirement and capacity building project management and cross-departmental cooperation awareness-raising for effort and expense transition from project to operational business + Benefits vendor independence software tailored to our needs more options for action active support of open standards capacity building

+ ! Challenges increased staff requirement and capacity building project management and cross-departmental cooperation awareness-raising for effort and expense transition from project to operational business Benefits vendor independence software tailored to our needs more options for action active support of open standards capacity building

Any questions? Please feel free to contact us! Leipzig University Library, Germany Code on Github: Python: Go: OAI-Harvester: Leander Seige Head of IT Evelyn Weiser Head of e-resources Annika Domin amsl ERMS