Current trends and Practices in Library Technologies Marshall Breeding Independent Consultant, Author, and Founder and Publisher, Library Technology Guides http://librarytechnology.org/ http://twitter.com/mbreeding 2018 Library Technology Conclave 24 January 2018
Description In this Keynote presentation, Marshall Breeding will give an overview of current and emerging trends in the products and services used by libraries for resource management, discovery, and other aspects of their operations and services. Breeding will discuss topics including trends for library management systems based on open source software and those provided as proprietary products, different models of resource management, discovery interfaces and index-based discovery services, and the increasingly different requirements across library types. Emphases will be given to the trends seen in countries such as India compared to other global regions
Perspective and Context Increasing divergence among library types regarding requirements for supporting technical infrastructure: Academic, Public, National, School, Special Approaches to library service vary according to international region Broad range of economic capacity or support across countries and regions and even within some countries. (especially United States)
Indian Library Perspective Librarians must adapt global technologies to their local context A large and diverse country Many different languages (22 official) High capacity for technology: many companies outsource software development to India Libraries in India have limited financial resources and strive to implement effective solutions
Library Technology Guides https://librarytechnology.org
Libraries.org directory Global directory of libraries Descriptive data (location, type, collection size, etc) Technology: ILS, Discovery, etc: past and present Lists, maps, reports
Library Tech Mergers
Key Vendors
Migration Reports
Vendor Personnel Statistics
Library Technology Industry Recent Trends and Events
Library Technology Industry Reports American Libraries Library Journal 2013: Rush to Innovate 2012: Agents of Change 2011: New Frontier 2010: New Models, Core Systems 2009: Investing in the Future 2008: Opportunity out of turmoil 2007: An industry redefined 2006: Reshuffling the deck 2005: Gradual evolution 2004: Migration down, innovation up 2003: The competition heats up 2002: Capturing the migrating customer 2014: Strategic Competition and Cooperation 2015: Operationalizing Innovation 2016: Power Plays 2017: Competing visions for Technology, openness, workflows
“Competing visions for technology, openness, and workflow” Library System Report 2017 “Competing visions for technology, openness, and workflow” https://americanlibrariesmagazine.org/2017/05/01/library-systems-report-2017/
2017: Competing Visions Assembly of companies with involvement in business activities spanning technology and content Synergies among business activities which will give insight to inform business strategies without imposing control on their library customers Horizontal and Vertical Consolidation Mergers among companies with similar business activates Expansion into new areas of business Library technology increasingly part of the mix
Consolidation: deep and wide Horizontal consolidation: M&A among ILS and RFID companies SirsiDynix Innovative Bibliotheca Lucidea Vertical Consolidation: Acquisition into top-level companies Content + Technology + Services ProQuest: Acquisition of Ex Libris, Serials Solutions EBSCO: FOLIO, Stacks, etc Follett: Acquisition of Baker & Taylor
Transition in Scholarly Publishers Comparison of Research Search and workflow Tools Elsevier Digital Science Clarivate Citation database Scopus Dimensions Web of Science Content indexed 69 million publications from 5,000 publishers; 22,800 journals; 150,000 books 89 million publications; 870 million citations 68 million publications; 33,000 journals; 88,000 books Analytics SciVal Plum Analytics PlumX Altmetric InSites Essential Science Indicators Reference Manager Mendeley EndNote Research information management system Pure Symplectic management system for journals ScholarOne Peer review tracking and recognition Publons Research data repository FigShare Institutional article repository bepress Scientific collaborative network SSRN Media monitoring of articles and research Newsflo Collaborative writing and publishing tool Hivebench electronic lab notebook Overleaf Decision support for science funding ÜberResearch Ownership RELX (previously Reed Elsevier. Publicly traded on London Stock Exchange and Amsterdam Stock Exchange) Holtzbrinck Publishing Group Baring Private Equity Asia (previously part of Thompson Reuters)
General Technology Trends
Fundamental technology shift Mainframe computing Client/Server Cloud Computing http://www.flickr.com/photos/carrick/61952845/ http://soacloudcomputing.blogspot.com/2008/10/cloud-computing.html http://www.javaworld.com/javaworld/jw-10-2001/jw-1019-jxta.html
Software Development Styles Monolithic Applications Codebase of application deployed as a single bundle of executables and libraries on a unified platform Microservices Architecture Multiple independent software components orchestrated to form a unified application Common infrastructure: User interface toolkit API Gateway Persistence layer
} Monolithic Application: Enterprise SOA Model Scripts/ Third Party Systems User Interfaces API endpoints Web service Presentation Layer Application software Business Logic } Reusable Composable Services Enterprise Service Bus Database Engine Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table
Microservices-based Application Scripts/ Third Party Systems User Interfaces API endpoints Presentation Layer / UI Toolkit API Gateway Microservice Data Store Web service Run time libraries Application software Service components Microservice Data Store Web service Run time libraries Application software Service components Microservice Data Store Web service Run time libraries Application software Service components Microservice Data Store Web service Run time libraries Application software Service components Microservice Data Store Web service Run time libraries Application software Service components Microservice Data Store Web service Run time libraries Application software Service components Microservice Data Store Web service Run time libraries Application software Service components Microservice Data Store Web service Run time libraries Application software Service components Microservice Data Store Web service Run time libraries Application software Service components Microservice Data Store Web service Run time libraries Application software Service components Persistence / System Layer
Software as a Service Multi Tennant SaaS is the modern approach One copy of the code base serves multiple sites Software functionality delivered entirely through Web interfaces No workstation clients Upgrades and fixes deployed universally Usually in small increments
Data as a service SaaS provides opportunity for highly shared data models E-resource knowledge bases Article-level discovery indexes Shared vendor profiles General opportunity to move away from library- by-library metadata management to globally shared workflows
Open Systems Achieving openness has risen as the key driver behind library technology strategies Libraries need to do more with their data Ability to improve customer experience and operational efficiencies Demand for Interoperability Open source – full access to internal program of the application Open API’s – expose programmatic interfaces to data and functionality
Open Source Software Expanding access to technology
General observations Wealthy regions primarily use proprietary products Sophisticated systems, but with substantial costs for libraries Proprietary products not affordable by most libraries in developing world Open source ILS products have comparable capabilities and can be implemented at lower costs Gaps in functionality between open source and proprietary ILS products continue to narrow Open source options for electronic resource management are available, but have less capabilities Lack of open access knowledgebase and discovery index
Open Source vs Proprietary Software Library software available under both models Proprietary software tends to be adopted in libraries with more robust budgets …but many libraries in wealthy countries also use open source ILS products Open source software widely implemented in developing nations Commercial support of open source represents a growing portion of ILS implementations in the US
Open Source Software The source code to the software must be made available Can be modified and shared No fees can be charged for the software itself Fees can be charged for services for open source software products: Support Hosting Migration Customizations OSS licenses specify different terms for sharing, re-use, commercial use, etc. (GPL, Apache)
Trends in Open Source Open source now a routine segment of strategic library automation Implementation models: Commercial support Independent with community support Support through governmental organizations Development models Distributed community Mostly centralized within a commercial community (Example Kuali suite of applications for universities)
Open source Library Tech Products Integrated library systems: Koha Evergreen ABCD ILS based on CDS/ISIS components Library Services Platforms FOLIO Still in development phase Discovery interfaces VuFind (PHP + SOLR) Blacklight (Ruby + SOLR)
Open Source ILS in the United States Koha: small to mid-sized public libraries Schools Some small to mid-sized academics for print collections; reliance on Coral or other products for electronic resource management Evergreen Public library consortia Typical: large consortium comprised mostly of small and mid-sized public libraries Koha + Evergreen: about15% of overall ILS deployments
Koha Originally developed in 1999 for small group of libraries in New Zealand, Horowhenua Library Trust by Katipo Communications, production use by January 2000 Gained widespread use in the United States around 2004-05 and has seen steady growth in use Wide international adoption Used in many thousands of libraries. 2,682 represented in libraries.org, with many large groups not yet registered. Dominant open source SIGB in Latin America
Koha Worldwide
National Projects to deploy Koha Philippines: A systematic effort to install Koha in the public libraries sponsored by the state libraries Turkey: 1,200+ public libraries Spain: Koha-Kobli http://kobli.bage.es/ Argentina. CONABIP (Comisión Nacional de Bibliotecas Populares) Customized version of Koha: DigiBepe http://www.conabip.gob.ar/faq/digibepe
Koha in India Widespread use throughout the country Other systems used include LibSys and other locally developed systems Municipal library systems (Delhi Public Library) University, public, and school libraries Large number of consulting firms provide implementation and support services for Koha in India Many Indian libraries implement Koha independently No systematic data on deployments Possible project to work on improving representation of libraries in India in the libraries.org director of libraries in Library Technology Guides
Evergreen Open source ILS originally developed for PINES consortium in Georgia Optimized for large consortia comprised of small to mid-sized public libraries Mostly implemented within United States and Canada
Evergreen Worldwide
Academic Library Perspective
Operational trends in large Academic Libraries Spending on Electronic Resources dominates budgets Generally flat budgets + 4% annual inflation = budget stress Decreasing spending on print monographs Transition from print to electronic journals complete, shift to e-books underway. Demand-driven acquisitions
Legacy: Fragmented Environment Integrated Library System for management of (mostly) print Duplicative financial systems between library and university Electronic Resource Management E-Resource knowledge base and Link Resolver A-Z e-journal lists and other finding aids Interlibrary loan (borrowing and lending) Digital Collections Management platforms (CONTENTdm, DigiTool, etc.) Separate systems for archival materials and special collections Discovery-layer services for broader access to library collections No effective integration services / interoperability among disconnected systems, non-aligned metadata schemes
Library Services Platform Library-specific software. Technical infrastructure to help libraries automate their internal operations, manage collections, fulfillment requests, and deliver services Services Services-oriented architecture Exposes Web services and other API’s Facilitates the services libraries offer to their users Platform General infrastructure for library automation Consistent with the concept of Platform as a Service Library programmers address the APIs of the platform to extend functionality, create connections with other systems, dynamically interact with data
Library Services Platforms New genre of resource management Workflows unified across electronic, print, and digital formats Flexible metadata management: MARC, Dublin Core, BIBFRAME, etc. Deployed via web-native multi-tenant platform Built-in analytics and decision support
Library Services Platforms – Functional Manages electronic and print formats of materials Replaces multiple incumbent products Extensive Metadata Management Multiple procurement workflows Knowledgebases Built-in collection analytics Decision support for collection development
Platform characteristics Technical infrastructure to support complex business applications Delivers common services: data stores, messaging, events, workflow engine Agnostic relative to structure of higher-level applications Common UI framework Designed for multitenancy
Shared Technology Infrastructure Increasing interest in shared technology infrastructure among members of library systems and consortia Shift from stand-alone implementations to shared infrastructure Remove obstacles to strategic collaboration Collaborative Collection Development Shared access to collections Re-distribution of technical services Ability to share language experts and subject specialists
Benefits of shared infrastructure Increased cooperation and resource sharing Collaborative collection management Lower costs per institution Greater universe of content readily available to patrons Avoid add-on components for union catalog and resource requests and routing
Shared infrastructure Projects Orbis Cascade WHELF South Australia Ireland Public Libraries JULAC California State University University System of Georgia Complete Florida Plus Program University of Wisconsin system
Beyond the Library Services Platform More efficient ways to manage collections is a positive move, but not in itself transformative Build on the LSP infrastructure to support new areas of library service Involvement with the management, preservation, and access of research data Deeper involvement in teaching activities: resource lists for courses; other areas of curriculum support Facilitate collaboration among students, faculty within the institution and globally Help expand the impact of libraries globally
Public Library Perspective
Public Library Perspective Operational strategies distinct from academics Vigorous lending services of physical materials Emphasis on customer engagement Lending of downloadable e-books and audiobooks; streaming of digital content Delivery of collection access and services via mobile devices Requirements for organically integrated environments which promote the brand and services of the library
ILS reigns in public libraries No re-designed platforms for public libraries Axiell recently announced a library services platform for public libraries (initially for France and Norway) ILS model remains in place Evolving toward modern platforms New e-book functionality layered in
Technology Characteristics Originally mainframe/terminal Adapted to Client/Server Web-based online catalogs Dedicated Staff clients Windows or Java Demand for Web-based staff clients
Emphasis on Digital Lending Services Most public libraries offer some type of e-book lending service Ongoing reliance on content provided by OverDrive, Recorded Books, Bibliotheca, Odilo and others Interest in library centered e-book lending solutions NYPL: SimplyE App (created as part of the Library Simplified imitative)
E-book integration link to provider’s platform Load bibliographic records in catalog API integration to enable full discovery, search, and download from library catalog
E-Book Integration Model Aggregated Content packages Search: ILS Data Library Catalog Index Search Results Web Site Content Digital Collections Authentication Checkout - Download External E-Book Lending Service Local E-book Repository Discovery
Resource Discovery Trends
Current state Academic Libraries: Public Libraries Index-based model dominates 3: Ex Libris, EBSCO, OCLC Emerge genre of AI-based tools for discovery and exploration of scholarly literature Public Libraries Online catalogs or discovery interfaces from ILS Vendor Replacement Discovery Interfaces Comprehensive Library portals
Web-scale Index-based Discovery ILS Data Web-scale Index-based Discovery (2009- present) Digital Collections Search: Web Site Content Institutional Repositories Aggregated Content packages Search Results Consolidated Index Open Access … E-Journals Usage-generated Data Customer Profile Reference Sources Pre-built harvesting and indexing
Bento Box Discovery Model Aggregated Content packages Search: Open Access ILS Data VuFind / Blacklight E-Journals Consolidated Index Search Results Web Site Content Digital Collections Institutional Repositories Pre-built harvesting and indexing
Yewno Discovery New approach to discovery based on exploring concepts rather than keywords Spin-off from Stanford University, led by Ruggero Gramatica Uses machine learning to extract concepts from documents Visual interface for navigating and exploring concepts within the body of documents
Discovery beyond Library Interfaces Improved performance of library content through Google Scholar Same expectations for transparency? Better exposure of library-oriented content Schema.org or other microdata formats Better exposure of scholarly resources Open access and Proprietary Embedded tools in other campus interfaces
Concluding observations Libraries in India need to be aware of the global context Work toward selections of local and global solutions that fit your strategies and requirements Leverage the deep technical capacity to contribute to open source projects and vendor initiatives to advance library technologies for Indian libraries.
Questions and discussion