1. HARVARD DISCOVERY DAY Marshall Breeding Independent Consult, Author, Founder and Publisher, Library Technology Guides http://www.librarytechnology.org/ http://twitter.com/mbreeding November 13, 2013 Harvard Discovery Day Discovery Trends and Issues Twitter hashtag: #discoveryday

2. Discovery Resources

3. Discovery on LTG http://www.librarytechnology.org/discovery.pl

4. The Evolution of Library Resource Discovery

5. Discovery in ARL Libraries http://www.librarytechnology.org/arl-discovery.pl

6. Online Catalog  Books, Journals, and Media at the Title Level  Not in scope:  Articles  Book Chapters  Digital objects Scope of Search Search: Search Results ILS Data

7. Next-gen Catalogs or Discovery Interface  Single search box  Query tools  Did you mean  Type-ahead  Relevance ranked results  Faceted navigation  Enhanced visual displays  Cover art  Summaries, reviews,  Recommendation services  Books, Journals, and Media at the Title Level  Other local and open access content  Not in scope:  Articles  Book Chapters  Digital objects  Scope of Search

8. Discovery Interface search model Search: Digital Collections ProQuest EBSCOhost … MLA Bibliography ABC-CLIO Search Results Real-time query and responses ILS Data Local Index MetaSearch Engine

9. Discovery from Local to Web-scale  Initial products focused on interface improvements  AquaBrowser, Endeca, Primo, Encore, VuFind,  Civica Sorcer, Axiell Arena  Mostly locally-installed software  Current phase is focused on pre-populated indexes that aim to deliver Web-scale discovery  Primo Central (Ex Libris)  Summon (Serials Solutions)  WorldCat Local (OCLC)  EBSCO Discovery Service (EBSCO)  Encore ES (+EDS Index)

10. Public Library Information Portal Search: Digital Collections Web Site Content Community Information … Customer- provided content Reference Sources Search Results Pre-built harvesting and indexing Consolidated Index ILS Data Aggregated Content packages Archives Usage- generated Data Customer Profile

11. Discovery services as Website Replacement  Portal environment that includes customized content management service that can fulfill typical offerings on library Web sites  Full integration between Web site and resource discovery (ideally)  Examples:  Axiell Arena  Infor Iguana

12. Web-scale Index-based Discovery Search: Digital Collections Web Site Content Institutional Repositories … E-Journals Reference Sources Search Results Pre-built harvesting and indexing Consolidated Index ILS Data Aggregated Content packages (2009- present) Usage- generated Data Customer Profile Open Access

13. Bento Box Discovery Model Search: Digital Collections Web Site Content Institutional Repositories E-Journals Search Results Pre-built harvesting and indexing Consolidated Index ILS Data Aggregated Content packages Open Access VuFind / Blacklight

14. Web-scale Search Problem Search: Search Results Pre-built harvesting and indexing Consolidated Index ?? ? Non Participating Content Sources Non Participating Content Sources Problem in how to deal with resources not provided to ingest into consolidated index Digital Collections Web Site Content Institutional Repositories … E-Journals ILS Data Aggregated Content packages

15. Citations / Metadata > Full Text  Citations or structured metadata provide key data to power search & retrieval and faceted navigation  Indexing Full-text of content amplifies access  Important to understand depth indexing  Currency, dates covered, full-text or citation  Many other factors

16. Challenge for Relevancy  Technically feasible to index hundreds of millions or billions of records through Lucene or SOLR  Difficult to order records in ways that make sense  Many fairly equivalent candidates returned for any given query  Must rely on use-based and social factors to improve relevancy rankings  Objectivity: Does relevancy reflect bias or publisher preferences

17. Challenges for Collection Coverage  To work effectively, discovery services need to cover comprehensively the body of content represented in library collections  What about publishers that do not participate?  Is content indexed at the citation or full-text level?  What are the restrictions for non-authenticated users?  How can libraries understand the differences in coverage among competing services?

18. Evaluating the Coverage of Index- based Discovery Services  Intense competition: how well the index covers the body of scholarly content stands as a key differentiator  Difficult to evaluate based on numbers of items indexed alone.  Important to ascertain now your library’s content packages are represented by the discovery service.  Important to know what items are indexed by citation and which are full text  Important to know whether the discovery service favors the content of any given publisher

19. Non-Cooperative Scenarios  Many A&I and specialized resources do not contribute to Discovery services  Two major players are both publishers and discovery service providers  EBSCO – ProQuest  ProQuest does not provide content to other discovery services  EBSCO does not provide content to other discovery services  Issue currently being pressed by Orbis Cascade Alliance.

20. Open Discovery Initiative  NISO Work Group to Develop Standards and Recommended Practices for Library Discovery Services Based on Indexed Search  Informal meeting called at ALA Annual 2011  Co-Chaired by Marshall Breeding and Jenny Walker  Term: Dec 2011 – Dec 2013 http://www.niso.org/workrooms/odi/

21. Balance of Constituents LibrariesPublishersService Providers 21 Marshall Breeding, Vanderbilt University Jamene Brooks-Kieffer, Kansas State University Laura Morse, Harvard University Ken Varnum, University of Michigan Sara Brownmiller, University of Oregon Lucy Harrison, College Center for Library Automation (D2D liaison/observer) Michele Newberry Lettie Conrad, SAGE Publications Roger Schonfeld, ITHAKA/JSTOR/Portico Jeff Lang, Thomson Reuters Linda Beebe, American Psychological Assoc Aaron Wood, Alexander Street Press Jenny Walker, Ex Libris Group John Law, Serials Solutions Michael Gorrell, EBSCO Information Services David Lindahl, University of Rochester (XC) Jeff Penka, OCLC (D2D liaison/observer)

22. ODI Project Goals:  Identify … needs and requirements of the three stakeholder groups in this area of work.  Create recommendations and tools to streamline the process by which information providers, discovery service providers, and librarians work together to better serve libraries and their users.  Provide effective means for librarians to assess the level of participation by information providers in discovery services, to evaluate the breadth and depth of content indexed and the degree to which this content is made available to the user.

23. ODI Timeline MilestoneTarget DateStatus Appointment of working groupDec 2011 Approval of charge and initial work planMar 2012 Agreement on process and toolsJun 2012 Completion of information gatheringJan 2013 Completion of initial draftJun 2013 Completion of final draftSep 2013 Public Review Period commencesSep 2013 23

24. Social Discovery

25. A more social user experience  Ratings, rankings, reviews  Enhanced content  Connections with the library  Connections with other users  Challenge: Must have critical mass of engagement to have an impact

26. Social Strategies  Inherent  BiblioCommons: design and infrastructure created with social flavor and features  Layered or integrated  ChiliFresh: integrate a third party social platform into any given library catalog or discovery service

27. Socially-powered discovery  Leverage use data to increase effectiveness of discovery  Usage data can identify important or popular materials to inform relevancy engines  Identify related materials that may not otherwise be uncovered through keyword matching  Be careful to avoid introducing bias loops

28. E-Book Integration

29. Critical concern for public libraries  Most libraries offer e-book lending programs  Strong demand: increasing use statistics  Print lending remains vigorous  Academic libraries will benefit at a later phase by e-book lending models developed in the public library sector

30. Commercial library e-book lending services  OverDrive  3M Cloud Library  Baker & Taylor: Axis 360  “Douglas County Model”  Locally curated e-book collections and lending platform

31. E-book Lending Models  Phase I: Link out to e-book lending service  Phase II: Load MARC records in local catalog, then link out on individual titles  Phase III: Discovery and lending operations performed fully within the library’s catalog or discovery environment

32. Full e-book lending  Discovery of print and e-book titles and copies simultaneously  E-book transactions represented within patron’s library account  List of charged items, due dates  Service options: renew, return, etc.  Ability to check-out and download e-books into e- reader

33. Library Interfaces with e-book Integration  Polaris PowerPAC  BiblioCommons  SirsiDynix eResource Central  Innovative Interfaces: Encore ES  TLC: LS2 PAC  OdiloTK from OdiloTID

34. The e-book integration ecosystem  E-book lending services must expose APIs  Online catalog or discovery services must consume APIs and adjust interface design and business logic to accommodate discovery and lending operations  Challenge: each e-book service provider’s APIs are different  Response: Work toward consistent or standard suite of APIs

35. Library Technology Reports  The Current State of Library Resource Discovery Products: Context, Library Perspectives, and Vendor Positions  In press for Publication January 2014

36. LTR Components  Vender questionnaire  Library Survey  Industry announcements  Other articles and publications

37. Library Discovery Survey Academic 247 Consortium 15 Government Agency 2 Law 7 Medical 5 Museum 1 National 1 Other 1 Public 96 Special 14 State 4 Theology 3  Survey executed to gather data from libraries regarding their experiences with discovery services  Responses received by 396 Libraries:  29 Countries represented, 252 responses from United States

38. Overall Satisfaction

39. Overall Effectiveness

40. Comprehensiveness: Academic Libraries

41. Relevancy Effectiveness

42. Objectivity in Discovery

43. Objectivity in Discovery: Academics

44. Example Product rating chart

45. Google Scholar  Default starting point for most researchers  Mostly outside of library control  Libraries can register link resolvers to facilitate access to subscribed documents from registered IP addresses  Recent cooperation between Thompson Reuters Web of Science and Google Scholar  Signals deeper interest by Google in academic resource discovery arena  Core service for Google? http://www.google.com/intl/en/scholar/libraries.html

46. Discovery Trends

47. Discovery Service Installations Product200720082009201020112012Installed EBSCO EDS5,000 Primo1237535061111011900 AquaBrowser5533964697458750 Encore72 1095672365 LS2 PAC 4677588873305 Summon 50164214158704 Enterprise 16 75100102328 Civica Sorcer 71222342 Axiell Arena 61573376 Chamo 1034723100

48. Trend Increased uptake in academic libraries of Web-scale discovery services  Almost a “must-have” product as one component of overall resource discovery and dissemination strategy  Yet, the number of discovery service installations remains a fraction of library management systems.

49. Counter trend  Some libraries resist investing in a discovery service citing:  Google Scholar performs adequate discovery  High cost of discovery services  Concerns for bias

50. Trend Tendency toward re-alignment with management systems  Alma + Primo / Primo Central  Sierra + Encore  WorldCat Local + WorldShare Management Services  Intota + Summon

51. Library Services Platform  Library-specific software. Designed to help libraries automate their internal operations, manage collections, fulfillment requests, and deliver services  Services  Service oriented architecture  Exposes Web services and other API’s  Facilitates the services libraries offer to their users  Platform  General infrastructure for library automation  Consistent with the concept of Platform as a Service  Library programmers address the APIs of the platform to extend functionality, create connections with other systems, dynamically interact with data

52. Library Services Platform Characteristics  Highly Shared data models  Knowledgebase architecture  Some may take hybrid approach to accommodate local data stores  Delivered through software as a service  Multi-tenant  Unified workflows across formats and media  Flexible metadata management  MARC – Dublin Core – VRA – MODS – ONIX  BIBFRAME  New structures not yet invented  Open APIs for extensibility and interoperability

53. Library Services Platforms Category WorldShare Management Services AlmaIntota Sierra Services Platform Kuali OLE Responsible Organization OCLC.Ex Libris Serials Solutions Innovative Interfaces, Inc Kuali Foundation Key precepts Global network-level approach to management and discovery. Consolidate workflows, unified management: print, electronic, digital; Hybrid data model Knowledgeba se driven. Pure multi- tenant SaaS Service-oriented architecture Technology uplift for Millennium ILS. More open source components, consolidated modules and workflows Manage library resources in a format agnostic approach. Integration into the broader academic enterprise infrastructure Software model Proprietary Open Source

54. Consolidated index Unified Presentation Layer Search: Digital Coll ProQuest EBSCO … JSTOR Other Resources New Library Management Model ` API Layer Library Services Platform Learning Management Enterprise Resource Planning Stock Management Self-Check / Automated Return Authentication Service Smart Cad / Payment systems Discovery Service

55. Development / Deployment perspective  Beginning of a new cycle of transition  Over the course of the next decade, academic libraries will replace their current legacy products with new platforms  Not just a change of technology but a substantial change in the ways that libraries manage their resources and deliver their services

56. Convergence  Discovery and Management solutions will increasingly be implemented as matched sets  Ex Libris: Primo / Alma  Serials Solutions: Summon / Intota  OCLC: WorldCat Local / WorldShare Platform  Except: Kuali OLE, EBSCO Discovery Service  Both depend on an ecosystem of interrelated knowledge bases  API’s exposed to mix and match, but efficiencies and synergies are lost

57. Why integrate resource management and discovery?  Obviates the need to constantly synchronize local inventory metadata representations into derivative discovery environment  Transactional efficiency for real-time status and user- initiated requests and services  Strategic Knowledge base: resource management, linking, scoping of discovery  Conceptual and technical cohesion  Possible cost savings relative to purchasing separately  Simplified support and business relationships

58. Counter trend Many libraries continue separate discovery strategies  Open source discovery + licensed Web-scale index  EBSCO Discovery Service: strategy to integrate with any back-end ILS or LSP

59. Why not integrate management and discovery?  Less dependence on single supplier  Best of breed in each product category  Increased customizability and local integration

60. Trend Demise of the local catalog  Many library services platforms do not include the concept of an online catalog dedicated to local physical inventory  Designed for discovery services as public-facing interface  Implication: Discovery service must incorporate detailed functionality for local materials and related services

61. Trend Content providers cooperate with discovery service providers for indexing in Web-scale services  New content partnerships continue to be announced  Web-scale discovery service providers assert that most scholarship in English now well covered and are now focusing on international and specialized resources

62. Trend Evolving ecosystems of content discovery, resource management and discovery  Single organization involved in the provision of  content resources  resource management services Focus on usage analytics  discovery services Can discovery be used to influence content acquisition?

63. Example:  ProQuest:  ProQuest content products  Summon  Intota Initial module: Intota Assessment  EBSCO Information Services  Subscription Services  EBSCOENT: ERM Essentials  EBSCOhost content platform  EBSCO Discovery Service

64. Future of A&E versus Discovery Services?  Will discovery services eventually become powerful enough to displace need for abstracting and indexing services?  How much does specialized vocabulary and other metadata contribute to the discovery process?  Specialized and scoped search methodologies  Researchers value this tools

65. Counter Trend A&I providers and aggregators less likely to participate  Competitive issues  Need to preserve the value of maintaining subscriptions

66. Trend Public libraries moving back to discovery interface associated with their ILS  ILS Online Catalog modules now offer most discovery interface characteristics  Examples:  Most libraries using Polaris ILS use Polaris PowerPAC catalog interface. Displacing AquaBrowser or Endeca  TLC libraries have largely abandoned AquaBrowser for LS2 PAC

67. Counter Trend BiblioCommons  BiblioCommons is the primary discovery layer widely implemented in public libraries that continues to replace ILS online catalog modules

68. Trend Strategic cooperation for management and discovery infrastructure  New combinations of libraries forming partnerships  Examples: 2CUL, Orbis Cascade Alliance  Model of single-institution infrastructure increasingly challenged

69. Trend Increased universe of discovery through highly-shared infrastructure  Built-in resource sharing by many libraries participating in shared automation environment

70. Open Access Discovery Services  Will cooperative open access / open source discovery services emerge?  Cons:  Very high investment costs: platform, publisher relations, content acquisition for indexing, synchronization  Multi-million dollar investment and operational support  Pros:  More control and transparency for libraries

71. Major Products

72. Serials Solutions: Summon  Launched in June 2009  First “web-scale” discovery service  Unified search results, facets, etc  Summon 2.0 released in 2013  Emphasis on tools to provide research assistance beyond search results  Topic explorer, scholar profiles, database recommender, content spotlighting, etc

73. Ex Libris: Primo / Primo Central  Primo (discovery interface) launched in 2005  Deployed locally or cloud  Primo Central: article-level index introduced in 2009  Index maintained by Ex Libris, cloud hosted  Scholar Rank: technology designed to order search results according to scholarly importance

74. EBSCO Discovery Service  Extends EBSCOhost platform with non-EBSCO content  Users comfortable with EBSCOhost interface will easily adapt to EDS  Platform Blending  Direct delivery of full-text from EBSCO sources  Linking to full text for non-EBSCO content http://www.ebscohost.com/discovery

75. WorldCat Local  Statistics from OCLC web site:  952+ million articles with one-click access to full text  38+ million digital items from trusted sources like Google Books, OAIster and HathiTrust  14+ million eBooks from leading aggregators and publishers  48+ million pieces of evaluative content (Tables of Contents, cover art, summaries, etc.) included at no additional charge  232+ million books in libraries worldwide http://www.oclc.org/worldcat-local.en.html

76. Innovative Interfaces: Encore  Initial version: discovery interface only with local index  Encore Synergy: XML Web services interfaces to resource targets for articles  Encore / EDS integration: agreement with EBSCO to integrate EDS for mutual subscribers

77. BiblioCommons: BiblioCore  Discovery service oriented to public libraries  Social features – share reading lists, etc  E-book discovery and lending integration  Full replacement for online catalog  Pooling of patrons across participating library organizations

78. Blacklight  Open source discovery interface  Originated at the University of Virginia  Increasing interest by academic libraries  Stanford, Columbia, Cornell, etc  No open access article-level index

79. VuFind  Open source discovery interface  Originally developed at Villanova University  Widely deployed  Web-scale indexes integrated by subscribers through APIs  No open access article-level index

80. Axiell: Arena  Comprehensive library portal  Discovery + Web site features  Positioned as discovery interface for Axiell’s several ILS products  Discovery layer for Archival products: CALM and Adlib  Can front both Library and Archival or museum products simultaneously: CultereNet

81. Infor: Iguana  Comprehensive library portal  Discovery + Web site features  Widget based architecture  Positioned as marketing and communications portal  Replaces both online catalog and Web site

82. Catalog 2.0  Edited by Sally Chambers  Chapter: “Next- generation discovery: an overview of the European scene”

83. Library Technology Report: 2007  Introduction to next- generation library catalogs or discovery interfaces  Trends  Profiles of major products

84. Next-Gen Library Catalogs Marshall Breeding Neal-Schuman Publishers March 2010 Volume 1 of The Tech Set

86. Questions and discussion