Discovery and Discoverability Current Issues and Trends Marshall Breeding Independent Consultant, Author, and Founder and Publisher, Library Technology Guides https://librarytechnology.org/ https://twitter.com/mbreeding Big Ten Academic Alliance Library Initiatives Conference May 30, 2018

Description The Big Ten Academic Alliance Libraries as a consortium of major academic libraries are engaged in many initiatives to enable enhanced discovery and delivery of their collection resources. Breeding reviews the current state of discovery products and the technologies and services able to make library collections more widely discoverable beyond the library-provided interfaces.

Library Technology Guides https://librarytechnology.org

Big Ten Libraries Technology data from Library Technology Guides

Big 10: Automation Systems

Big 10: Discovery Services

Library Technology Industry Reports American Libraries Library Journal 2013: Rush to Innovate 2012: Agents of Change 2011: New Frontier 2010: New Models, Core Systems 2009: Investing in the Future 2008: Opportunity out of turmoil 2007: An industry redefined 2006: Reshuffling the deck 2005: Gradual evolution 2004: Migration down, innovation up 2003: The competition heats up 2002: Capturing the migrating customer 2014: Strategic Competition and Cooperation 2015: Operationalizing Innovation 2016: Power Plays 2017: Competing visions for Technology, openness, workflows 2018: New Technologies enable an expended vision of library services

“Competing visions for technology, openness, and workflow” Library System Report 2017 “Competing visions for technology, openness, and workflow” https://americanlibrariesmagazine.org/2017/05/01/library-systems-report-2017/

2017: Competing Visions Assembly of companies with involvement in business activities spanning technology and content Synergies among business activities which will give insight to inform business strategies without imposing control on their library customers Horizontal and Vertical Consolidation Mergers among companies with similar business activates Expansion into new areas of business Library technology increasingly part of the mix

Consolidation: deep and wide Horizontal consolidation: M&A among ILS and RFID companies SirsiDynix Innovative Bibliotheca Lucidea Vertical Consolidation: Acquisition into top-level companies Content + Technology + Services ProQuest: Acquisition of Ex Libris, Serials Solutions EBSCO: FOLIO, Stacks, etc Follett: Acquisition of Baker & Taylor

“New Technologies Enable an Expanded vision of Library Services” Library System Report 2018 “New Technologies Enable an Expanded vision of Library Services”

2018: New Tech / Expanded Vision Resource Management and Discovery products relatively mature Increased interest on products supporting services beyond collections Extend academic library technologies in support of the research agenda of the university Support teaching through learning management integration and copyright management Advancing resource sharing strategies Ex Libris: shared resource management infrastructure for multi- campus systems and consortia OCLC: Consolidation of products for centralized and peer-to- peer interlibrary loan (WorldShare ILL, Relais D2D, Tipasa)

ProQuest – EBSCO dynamic EBSCO Information Service Content: ProQuest platform OASIS acquisitions Ex Libris + PQ product suite Alma Primo, Summon Strategy of platform bundling: Alma + Primo EBSCOhost EBSCO Discovery Service GOBI acquisitions service Strategy of Integrating discovery into all other platforms Open Source Strategy: FOLIO Koha

Scientific Workflow and Analytics   Elsevier Digital Science Clarivate Citation database Scopus Dimensions Web of Science Content indexed 69 million publications from 5,000 publishers; 22,800 journals; 150,000 books 89 million publications; 870 million citations 68 million publications; 33,000 journals; 88,000 books Analytics SciVal Plum Analytics PlumX Altmetric InSites Essential Science Indicators Reference Manager Mendeley EndNote Research information management system Pure Symplectic  Converis Journal Publication Manager ScholarOne / Publons Repository  bepress FigShare Scientific collaborative network SSRN Ownership RELX Holtzbrinck Publishing Group Baring Private Equity Asia

Models of Content Scope

Online Catalog Scope of Search ILS Data Online Catalog Search: Scope of Search Books, Journals, and Media at the Title Level Not in scope: Articles Book Chapters Digital objects Search Results

Web-scale Index-based Discovery ILS Data Web-scale Index-based Discovery (2009- present) Digital Collections Search: Web Site Content Institutional Repositories Aggregated Content packages Search Results Consolidated Index Open Access … E-Journals Usage-generated Data Customer Profile Reference Sources Pre-built harvesting and indexing

Bento Box Discovery Model Aggregated Content packages Search: Open Access ILS Data VuFind / Blacklight E-Journals Consolidated Index Search Results Web Site Content Digital Collections Pre-built harvesting and indexing Institutional Repositories Term attributed to Tito Sierra

E-Book Integration Model Aggregated Content packages Search: ILS Data Library Catalog Index Search Results Web Site Content Digital Collections Authentication Checkout - Download External E-Book Lending Service Local E-book Repository Discovery

Patron Privacy in Discovery

Online Privacy Concern Operating websites and discovery services without encryption enables third parties to intercept online activity of library patrons Search terms Search Results Items selected Items downloaded and read Important to implement https: Provides end-to-end encryption of user session

HTTPS urgency for libraries Browsers increasingly warn that http sites are insecure or untrusted Commercial sites mostly encrypt with https: Facebook – Twitter – Amazon - ….. Libraries continue to implement https inconsistently Running websites and discovery services on http is inconsistent with library values to protect the privacy of patrons

US public libraries using HTTPS (2017) https://librarytechnology.org/libraries/link-status.pl

US Academic libraries using HTTPS (May 2018)

Tracking tags Involves the insertion of code snippets or images which allow external entities to capture information regarding the use of a web-based resource Especially used by advertising networks Also used in performance monitoring Allows capture of user behavior even if page delivery is encrypted Uses third party cookies or unique identifiers to track users Libraries may not be aware of the tracking tags present within their pages Ghostery is an example of a tool to detect trackers

Resource Sharing Models

Integrated Library System Search: Bibliographic Database Library System Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Patrons use Circulation features to request items from other branches Model: Multi-branch Independent Library System Floating Collections may reduce workload for Inter-branch transfers

WorldCat Resource Sharing Patron has Citation for item not held by Library WorldCat User: Password: Place Request Needed by: Dec 30, 2012 5:00pm Interlibrary Loan Request Form WorldCat Resource Sharing Request Submission ILLiad Resource tracking and fulfillment Bibliographic Database Library System A Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Interlibrary Loan Personnel ILS Synchronization

Consortial Resource Sharing System Search: Bibliographic Database Library System A Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Bibliographic Database Library System D Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility NCIP Resource Sharing Application Bibliographic Database Discovery and Request Management Routines Staff Fulfillment Tools Inter-System Communications NCIP SIP ISO ILL Z39.50 NCIP Bibliographic Database Library System B Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Bibliographic Database Library System E Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility NCIP NCIP Bibliographic Database Library System C Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Bibliographic Database Library System F Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility NCIP NCIP

Bibliographic Database Shared Consortial ILS Search: Bibliographic Database Shared Consortia System Library 2 Library 3 Library 4 Library 5 Library 7 Library 8 Library 9 Library 10 Holdings Library 1 Library 6 Model: Multiple independent libraries in a Consortium Share an ILS ILS configured To support Direct consortial Borrowing through Circulation Module

Shared Infrastructure Participating institutions share a single instance of a Library Services Platform or Integrated Library System Consolidated bibliographic database

Denmark Joint Library System Shared instance of Cicero library management developed by Systematic ServespPublic and school libraries in all 98 Municipalities in Denmark 2,428 library facilities Serves population of 4.2 million 62 Million items 50+ million annual circulation transactions

Resource Sharing Products OCLC WorldShare ILL: centralized ILL Service ILLiad (Exclusive distributor for Atlas Systems) Tipasa: WorldShare app to replace ILLiad Some changes in focus of functionality Relais D2D (Acquired from founder in Jan 2017) Innovative Interfaces: Resource Sharing (formerly INN-Reach) Auto-Graphics: SHAREit

Index-based Discovery Services Mostly for Academic and Research libraries

Web-scale Index-based Discovery ILS Data Web-scale Index-based Discovery (2009- present) Digital Collections Search: Web Site Content Institutional Repositories Aggregated Content packages Search Results Consolidated Index Open Access … E-Journals Usage-generated Data Customer Profile Reference Sources Pre-built harvesting and indexing

EBSCO Discovery Service Most widely deployed index-based discovery service Extends EBSCOhost technology to the full body of scholarly literature (ideally) Assumes the primacy of subject indexing over keyword relevancy Designed to operate with any ILS product Partnerships with over 60 ILS vendors

WorldCat Discovery Service Based on the WorldCat bibliographic service Largest representation of monographic content Enhanced with article-level citation data for all scholarly literature (ideally) Default interface for WorldShare Management Services WorldCat Local can be integrated with other ILS products

Summon Originally developed by Serials Solution Became a division of ProQuest Full featured discovery interface, though not extensively customizable Central index populated with citations and full text from body of scholarly literature Relevancy rankings based on keyword algorithms optimized for scholarly resources Product will be maintained following merger with Ex Libris Central index will be synchronized with Primo Central

Primo / Primo Central Discovery interface introduced in 2007 Highly customizable, ILS content + repositories Customized content integration via “pipes” which define indexing rules, presentation, relevancy Primo Central index added in 2009 Designed to be integrated with any major ILS product Default interface for Alma

Possibilities for Open Access discovery index Open source tools exist for discovery Interfaces: VuFind Blacklight No open access discovery indexes High threshold of expense and difficulty to build index Platform costs Software development Publisher relations Billions of content items to index and maintain

Yewno Discovery New approach to discovery based on exploring concepts rather than keywords Spin-off from Stanford University, led by Ruggero Gramatica Uses machine learning to extract concepts from documents Visual interface for navigating and exploring concepts within the body of documents

Yewno Discovery interface Quick demo: https://www.youtube.com/watch?v=GSnhi55kmsY

Discoverability Enabling discovery of library resources through general web search engines

Browser Plugins Simple way to lead users to full text Examples: Unpaywall Offered by non-profit Impactstory Provides Unpaywall Data, a massive citation database, identifies open access content (100 million citations; 18 million open access articles) Koperio: acquired by Clarivate in April 2018 Library Access: plugin from Lean Library, startup out of Utrecht University

Discovery happens elsewhere* Only a portion of library users come to the libraries own website, catalog, or discovery service for research Important to have library-provided discovery options Also essential to ensure that library resources can be discovered and accessed through the general web. Google Scholar, Google, Microsoft Academic Search, etc Use Search Engine Optimization methodologies to expose library resources Lorcan Dempsey, VP and Chief Strategist OCLC

More Distributed Discovery Address the reality that discovery takes place outside of library provided interfaces Optimized exposure in the ecosystem of search engine and social network Not Concentrated on the Library web site Expression of discovery services via other campus tools and portals and beyond

Multi-layered discovery Native interfaces of specialized content services Disciplinary aggregations General library discovery tools Global Internet-based discovery

Library opts out of Discovery Utrecht University Library Decision to not implement a discovery service but to rely entirely on Google Scholar and other general and scholarly search engines http://www.uu.nl/en/university-library/searching- for-literature/searching-for-articles-books-theses (ongoing strategy as of 2017) Kortekaas , Simone. “Thinking the unthinkable: a library without a catalogue — Reconsidering the future of discovery tools for Utrecht University library.” LIBER General Annual Conference 2012

Discoverability Strategies Search Engine Optimization for library resources Linked data models: Schema.org BIBFRAME Commercial products Demco Software DiscoveryOocal Zepheira: Library.Link network, BIBFRAME, etc SirsiDynix BLUEcloud Visibility Innovative EBSCO Information Services

Schema.org Structured data methodology to deliver web-based resources that can be understood by computers as well as for presentation to humans Originally developed by Google, now widely supported by all search engines See: https://schema.org

Schema.org coding example <div itemscope="itemscope" itemtype="https://schema.org/Library"> <h2><meta itemprop="name" content="Nashville Public Library" /> <span itemprop="legalName">Nashville Public Library</span></h2> <div itemprop="address" itemscope itemtype="https://schema.org/PostalAddress"> Address: </span><span itemprop="streetAddress"> 615 Church Street<br /></span> …. </div> <!-- End microdata itemscope div -->

Google Structured Data Testing Tool

Zepheira Company specializing in linked data Involved in the development of BIBFRAME LibHub initiative: expose library data for discoverability Library.Link network open, decentralized, shared data platform Partnerships: SirsiDynix BLUEcloud Visibility Innovative: Linked Data EBSCO: Linked Library Service

Demco DiscoverLocal Designed to improve discoverability of library resources Library uploads records into Demco DiscoverLocal Records transformed into links harvested by search engines, enhanced with geolocation data Links are harvested by search indexing bots to better direct searches to local library’s collection

Koios SEO products for library collections Libre Ads Facilitates application for Google Ad Grants Help libraries set up ad campaigns Maintain grant Ongoing assistance in marketing campaigns

BiblioCommons Built-in search engine optimization Rich linking environment – one of the top characteristics Google considers for page ranking Library resources from libraries using BiblioCommons are well represented in general search results on Google

Mobile Discovery Google and other search engines increasingly consider search for mobile devices separately than general web search Avoid linking mobile devices to pages that they cannot display well Non-mobile friendly websites demoted or eliminated in mobile search results Essential for libraries to have responsive or mobile- friendly web sites

Resource Discovery Trends

Integrate Discovery with Resource Management? Should there be a tight bundling of Discovery Services with Library Services Platforms: WorldCat Discovery Services + WorldShare Management Services Alma + Primo or Summon Also support for Blacklight or VuFind EBSCO rejects tight bundling Partners with almost all ILS products Support for open source FOLIO project Many libraries prefer providing discovery separately

Discovery from Content Providers Two of the major discovery services are tied to content providers: EBSCO Information Services EBSCO Discovery Service ProQuest: Summon Primo + Primo Central Explicit bias would not be tolerated by libraries Providing discovery services can provide insight into content acquisition and patron behaviors

Open Discovery Initiative (ODI)

Goals of Open Discovery Initiative Define ways for libraries to assess the level of content provider participation and for discovery services to affirm how they use that content Help streamline the process by which content providers work with discovery service vendors Define models for “fair” linking from discovery services to publishers’ content Determine what usage statistics should be collected for libraries and for content providers From Library perspective: Web-scale discovery systems are increasingly important to the work of libraries in service of their users. As these discovery systems become more complex, librarians are less able to understand or explain to their users what content is included or how. The Open Discovery Initiative's recommended practice represents a significant opportunity to understand what is indexed, where it comes from, and how it is used.  Increasing need to ensure that the coverage meets our needs.

Recommended Practice A technical recommendation for data exchange including data formats, method of delivery, usage reporting, frequency of updates and rights of use A way for libraries to assess content providers’ participation in discovery services A model by which content providers work with discovery service vendors via fair and unbiased indexing and linking From Library perspective: Web-scale discovery systems are increasingly important to the work of libraries in service of their users. As these discovery systems become more complex, librarians are less able to understand or explain to their users what content is included or how. The Open Discovery Initiative's recommended practice represents a significant opportunity to understand what is indexed, where it comes from, and how it is used.  Increasing need to ensure that the coverage meets our needs.

Library Discovery Futures Beyond library-provided discovery

The future of Resource Discovery Discovery more integrated into a broader view of library content and services More comprehensive discovery indexes Discovery services enhanced by AI and machine learning Stronger technologies for search and retrieval Discovery beyond library-provided interfaces Linked Data to supplement discovery indexes

Future of discovery service products Remain one of the essential components of library technology infrastructure Loosely or tightly tied to resource management Increased sophistication in direct discovery and delivery functionality Increased expectation to syndicate content to local and global discovery context

The next phase of Discovery Now in a critical point for discovery Current products evolve Reaching limits of the prevailing architecture? Current set of products and services an interim step Important for stakeholders to engage in defining the future of library resource discovery Future products must address expected changes in scholarly publishing, library priorities, and institutional strategies.

Questions and discussion