1. NEXT-GENERATION LIBRARY DISCOVERY: Overview + Recent trends and developments Marshall Breeding Independent Consultand, Author, Founder and Publisher, Library Technology Guides http://www.librarytechnology.org/ http://twitter.com/mbreeding June 25, 2012 Computers in Libraries 2012

2. Abstract Marshall Breeding will give an overview of the current scene in library discovery services. He will review the major products and technologies and give an update on recent developments and trends that libraries should be aware of as they consider these products.

3. Challenge: Disjointed approach to information and service delivery  Library Web sites offer a menu of unconnected silos:  Books: Library OPAC (ILS online catalog module)  Articles: Aggregated content products, e-journal collections  OpenURL linking services  E-journal finding aids (Often managed by link resolver)  Subject guides (e.g. Springshare LibGuides)  Local digital collections ETDs, photos, rich media collections  Metasearch engines  Discovery Services – often just another choice among many  All searched separately

4. Online Catalog  Books, Journals, and Media at the Title Level  Not in scope:  Articles  Book Chapters  Digital objects  Web site content  Etc. Scope of Search Search: Search Results ILS Data

5. Next-gen Catalogs or Discovery Interface (2002-2009)  Single search box  Query tools  Did you mean  Type-ahead  Relevance ranked results (for some content sources)  Faceted navigation  Enhanced visual displays  Cover art  Summaries, reviews,  Recommendation services

6. Discovery Interface search model Search: Digital Collections ProQuest EBSCOhost … MLA Bibliography ABC-CLIO Search Results Real-time query and responses ILS Data Local Index MetaSearch Engine

7. Discovery Products http://www.librarytechnology.org/discovery.pl

8. Differentiation in Discovery  Products increasingly specialized between public and academic libraries  Public libraries: emphasis on engagement with physical collection  Academic libraries: concern for discovery of heterogeneous material types, especially books + articles + digital objects

9. Discovery from Local to Web-scale  Initial products focused on technology  AquaBrowser, Endeca, Primo, Encore, VuFind,  LIBERO Uno, Civica Sorcer, Axiell Arena  Mostly locally-installed software  Current phase is focused on pre-populated indexes that aim to deliver Web-scale discovery  Primo Central (Ex Libris)  Summon (Serials Solutions)  WorldCat Local (OCLC)  EBSCO Discovery Service (EBSCO)  Encore with Article Integration (no index, though)

10. Web-scale Index-based Discovery Search: Digital Collections Web Site Content Institutional Repositories … E-Journals Reference Sources Search Results Pre-built harvesting and indexing Consolidated Index ILS Data Aggregated Content packages (2009- present)

11. Web-scale Search Problem Search: Search Results Pre-built harvesting and indexing Consolidated Index ?? ? Non Participating Content Sources Non Participating Content Sources Problem in how to deal with resources not provided to ingest into consolidated index Digital Collections Web Site Content Institutional Repositories … E-Journals ILS Data Aggregated Content packages

12. Encore Synergy Search: Digital Collections ProQuest … Local Index ILS Data Web Services Local Index Results Remote Search Results EBSCOhost … MLA Bibliography ABC-CLIO

13. Consolidated index Search Engine Unified Presentation Layer Search: Digital Coll ProQuest EBSCO … JSTOR Other Resources New Library Management Model ` API Layer Library Services Platform Learning Management Enterprise Resource Planning Stock Management Self-Check / Automated Return Authentication Service Smart Cad / Payment systems Discovery Service

14. The Discovery Services Market

15. Adoption of Discovery Services  Next-gen catalogs or discovery services have been around since 2002  Many mature products  Continuing to evolve and expand  Online catalog components of ILS products have taken on many of the characteristics of discovery layers  Examples: LS2 PAC, Polaris PowerPAC

16. Discovery Service Installations Discovery Product20072008200920102011Installed Primo123753506111914 AquaBrowser55339646974254 Encore72 1095672326 LS2 PAC 46775888236 Summon 50164214407 Enterprise 16 75100251 Civica Sorcer 7122239 Axiell Arena 61573376 Chamo 1034751

17. EBSCO Discovery Service

18. Global Primo Installations

19. Summon Global Adoption

20. Expanding the Depth of Discovery

21. Citations / Metadata > Full Text  Citations or structured metadata provide key data to power search & retrieval and faceted navigation  Indexing Full-text of content amplifies access  Important to understand depth indexing  Currency, dates covered, full-text or citation  Many other factors

22. Full-text Book indexing  HathiTrust: 11 million volumes, 5.3 million titles, 263,000 serial titles, 3.5 billion pages  HathiTrust in Discovery Indexes  Primo Central (Jan 20, 2012) [previously indexed only metadata]  EBSCO Discovery Service (Sept 8 2011)  WorldCat Local (Sept 7, 2011)  Summon (Mar 28, 2011)

23. Challenge for Relevancy  Technically feasible to index hundreds of millions or billions of records through Lucene or SOLR  Difficult to order records in ways that make sense  Many fairly equivalent candidates returned for any given query  Must rely on use-based and social factors to improve relevancy rankings

24. Quest for Improved Relevancy  Example: Ex Libris Primo ScholarRank  Relevancy tuned for scholarly content  Uses bX data to assign score that reflects scholarly importance  Able to weight by disciplines and filter by other factors for signed-in users  Now available in Primo Version 4

25. Challenges for Collection Coverage  To work effectively, discovery services need to cover comprehensively the body of content represented in library collections  What about publishers that do not participate?  Is content indexed at the citation or full-text level?  What are the restrictions for non-authenticated users?  How can libraries understand the differences in coverage among competing services?

26. Evaluating the Coverage of Index- based Discovery Services  Intense competition: how well the index covers the body of scholarly content stands as a key differentiator  Difficult to evaluate based on numbers of items indexed alone.  Important to ascertain now your library’s content packages are represented by the discovery service.  Important to know what items are indexed by citation and which are full text  Important to know whether the discovery service favors the content of any given publisher

27. Open Discovery Initiative  NISO Work Group to Develop Standards and Recommended Practices for Library Discovery Services Based on Indexed Search  Informal meeting called at ALA Annual 2011  Co-Chaired by Marshall Breeding and Jenny Walker  Term: Dec 2011 – May 2013

28. Open Discovery Initiative stakeholders  Libraries: provide discovery services on behalf of their patrons  Publishers: provide content to be indexed by discovery services  Discovery Service Provides: develop discovery interfaces and populate indexes

29. ODI Project Goals:  Identify … needs and requirements of the three stakeholder groups in this area of work.  Create recommendations and tools to streamline the process by which information providers, discovery service providers, and librarians work together to better serve libraries and their users.  Provide effective means for librarians to assess the level of participation by information providers in discovery services, to evaluate the breadth and depth of content indexed and the degree to which this content is made available to the user.

30. Summon  Disciplined Scoped Searching  “With Summon, librarians can now easily create, customize and embed discipline scoped search boxes and search widgets in any web environment—including research guides, course management pages, collaborative research portals and more—to provide users with the ability to search for highly relevant materials from a discipline focused setting. ”

31. bX Recommendation Service  Makes associations among scholarly articles based on data mined from OpenURL resolver logs http://www.exlibrisgroup.com/category/bXUsageBasedServices http://www.exlibrisgroup.com/category/bXUsageBasedServices  Finds associations not apparent from keyword matching or controlled vocabularies  New Services:  bX Hot Articles (Current Month)  bX Most Popular Articles (Current Year)  bX Journal Popularity Report (Previous Quarter)  bX in Elsevier Scopus and Science Direct (limited to Elsevier content)

32. E-book Integration

33. The rise of e-books  Academic libraries: e-books included in aggregated content packages  E-books used primarily for research and consultation, not long reading  Public Libraries: Subscriptions to e-book services that provide an outsourced collection of loanable e- books  K-12 Schools, Colleges, Universities: interest in electronic textbooks

34. Integrating e-Books into Library Automation Infrastructure  Current approach involves mostly outsourced arrangements  Collections licensed wholesale from single provider  Hand-off to DRM and delivery systems of providers  Loading of MARC records into local catalog with linking mechanisms  No ability to see availability status of e-books from the library’s online catalog or discovery interface

35. Technology Issues  Access to materials controlled through Digital Rights Management  Closed ecosystems that control content through identity management and rights policies  Imposes significant overhead on the user experience:  Download an install DRM components  Establish user credentials in site trusted by DRM  Works only with devices that comply with DRM restrictions

36. BiblioCommons  Pilot at Boston Public Library, NYPL  Based on intercepting HTML from Overdrive  Project on hold until Overdrive Releases its API  Full e-lending capabilities within the discovery interface  Overdrive  See: http://www.bibliocommons.com/sites/default/files/ OverDriveintegrationcompanison.pdf http://www.bibliocommons.com/sites/default/files/ OverDriveintegrationcompanison.pdf

37. Polaris Library Systems  Announced e-book lending integrated within Polaris PowerPAC  3M Cloud Library  Expect partnerships with other e-book providers as APIs become available

38. Polaris e-book integration example

39. SirsiDynix eResource Central  New product to facilitate management of e-books and other electronic resources  Single click to read and download e-books  Initial partnership with Axis 360 from Baker and Taylor

40. Device Agnostic Interfaces must adapt to many devices Decoupled Discovery?  Decoupled interfaces emerged from broken online catalogs  Poor interfaces, inadequate scope  Inefficient integration between automation and discovery platforms  New wave of more tightly integrated suites:  Ex Libris Alma > Primo / Primo Central  OCLC WorldShare Management Services > WorldCat Local  Serials Solutions Intota > Summon  Still possible to decouple, but more effort, worse results

41. Next-Gen Library Catalogs Marshall Breeding Neal-Schuman Publishers March 2010 Volume 1 of The Tech Set

42. Questions and discussion