Empowering Library Discovery and Management Services with Social Data Marshall Breeding Independent Consultant, Author, and Founder and Publisher, Library Technology Guides http://librarytechnology.org/ http://twitter.com/mbreeding International Conference on E-Publishing 27 July, 2015
Description Marshall Breeding will give an overview of the current realm of library resource management systems and discovery services, highlighting some of the major technology trends. These products increasingly leverage use data and social networking concepts to provide more targeted and personalized services. Breeding will explore this trend among others and its implications for privacy and security of library users. Trends addressed include how social media has help shape the realm of E-Publishing.
Topics covered Reports and resources Trends in library resource management systems Trends in discovery services Discovery beyond the library Empowering Discovery with Social Data Trends in resource sharing and collaborative infrastructure
Library Technology Guides www.librarytechnology.org
Recent Reports American Libraries Library Systems Report 2015 online edition published May 1 “Operationalizing Innovation” Future of Library Resource Discovery NISO White Paper commissioned by the Document to Delivery Topic Committee Published Feb 20, 2015 Perceptions Surveys 2015 edition recently published http://librarytechnology.org/perceptions/2014/
Perceptions 2014 http://librarytechnology.org/perceptions/2014/ Annual survey for Libraries Satisfaction levels for Company Current ILS Service Loyalty Migration Plans 3,141 Responses 80 Countries
Perceptions Survey 2014 Sample: Large Academic Libraries
Libraries Considering Switching Systems
Satisfaction levels: Large Academic
Library Systems Report 2015 “Operationalizing innovation” http://americanlibrariesmagazine.org/2015/05/01/library-systems-report/
American Libraries Library Systems Report Library Systems Report 2014: Strategic Competition and Cooperation Online Publication: April 15, 2015 Covers 2014+ calendar year activities Report produced from: Questionnaire of statistics and narrative completed by each major vendor Press announcements made throughout the year Other background information
Library Technology Industry Reports American Libraries Library Journal 2013: Rush to Innovate 2012: Agents of Change 2011: New Frontier 2010: New Models, Core Systems 2009: Investing in the Future 2008: Opportunity out of turmoil 2007: An industry redefined 2006: Reshuffling the deck 2005: Gradual evolution 2004: Migration down, innovation up 2003: The competition heats up 2002: Capturing the migrating customer 2014: Strategic Competition and Cooperation 2015: Operationalizing Innovation
Industry Revenues $1.8 billion global industry $805 million from companies involved in the US $495 million from US Libraries
Personnel Resources 2014
Personnel Growth / Loss
Evolution of Resource Management
Transition to Electronic Publishing Academic libraries devote majority of collections budgets to electronic materials Open access represents a growing proportion of scholarly resources, though still a small minority Public libraries increasingly offer e-book lending services Academic libraries: primarily electronic collections Public Libraries: Primarily physical collections
Implications of e-publishing Resource management systems for academic libraries must be optimized for electronic resources License management Open access outside of paid subscriptions Portfolio-based management – use knowledge base to delineate individual titles and date coverage of aggregated content packages Efficiently manage e-books Demand-driven acquisitions
Fragmented Resource Management Integrated Library System for management of (mostly) print Duplicative financial systems between library and university Electronic Resource Management E-Resource knowledge base and Link Resolver A-Z e-journal lists and other finding aids Interlibrary loan (borrowing and lending) Digital Collections Management platforms (CONTENTdm, DigiTool, etc.) Separate systems for archival materials and special collections Discovery-layer services for broader access to library collections No effective integration services / interoperability among disconnected systems, non-aligned metadata schemes
Cycles of fragmentation > unification Early Phase: Modular automation Integrated Library Systems Proliferation of systems to manage electronic resources and digital collections Current unification phase: library services platforms bring together print and electronic resource management Next phase? Bring archival and digital assets under common management platform
Integrated (for print) Library System Staff Interfaces: Public Interfaces: Interfaces Business Logic Circulation Cataloging Acquisitions Serials Online Catalog Data Stores BIB Holding / Items Circ Transact User Vendor $$$ Funds Policies
LMS / ERM: Fragmented Model Circulation BIB Staff Interfaces: Holding / Items Circ Transact User Vendor Policies $$$ Funds Cataloging Acquisitions Serials Online Catalog Public Interfaces: Application Programming Interfaces ` E-resource Procurement License Management Protocols: CORE E-Journal Titles Vendors License Terms
Common approach for ERM Circulation BIB Staff Interfaces: Holding / Items Circ Transact User Vendor Policies $$$ Funds Cataloging Acquisitions Serials Online Catalog Public Interfaces: Application Programming Interfaces Budget License Terms Titles / Holdings Vendors Access Details
Comprehensive Resource Management Simplify resource management through platform consolidation Separate components: ILS + ERM + OpenURL Resolver + Digital Asset management, etc. very inefficient model Consolidation requires a flexible platform capable of managing multiple type of library materials, multiple metadata formats, with appropriate workflows
Library Services Platform Library-specific software. Technical infrastructure to help libraries automate their internal operations, manage collections, fulfillment requests, and deliver services Services Services-oriented architecture Exposes Web services and other API’s Facilitates the services libraries offer to their users Platform General infrastructure for library automation Consistent with the concept of Platform as a Service Library programmers address the APIs of the platform to extend functionality, create connections with other systems, dynamically interact with data
Library Services Platforms – Functional Manages electronic and print formats of materials Replaces multiple incumbent products Extensive Metadata Management Multiple procurement workflows Knowledgebases Built-in collection analytics Decision support for collection development
Knowledge bases Electronic Resource Management based on collective database of the body of e-content rather than library- by-library management LSP extends knowledge base model to all resources Make links or associations from local holdings to common bibliographic records WorldShare Management Services – based on WorldCat Bibliographic records Ex Libris Alma – includes Community Zone of shared records and resources Intota: expanded knowledge base that includes MARC and other resources
Support for BIBFRAME New bibliographic framework based on mapping MARC concepts and data into linked data model No direct support for BIBFRAME in either integrated library systems or library services platforms Developers are involved in BIBFRAME initiative Operational implementations will come once the model has stabilized Current phase of experimental projects and prototypes Applies differently to discovery versus resource management
Library Services Platforms – Technical Beyond Client/Server Computing Multi-tenant platforms Web-based interfaces Services-oriented architecture Exposes APIs for extensibility and interoperability Interoperable
New Library Management Model Consolidated index Unified Presentation Layer Search: Digital Coll ProQuest EBSCO … JSTOR Other Resources Self-Check / Automated Return ` API Layer Library Services Platform Discovery Service Stock Management Enterprise Resource Planning Smart Cad / Payment systems Learning Management Authentication Service
Resource Management Models Category Integrated Library System Progressive integrated library System Library Services Platform Resources managed Physical Print, electronic Electronic, Physical Technology platform Server-based Multi-tenant SaaS Knowledgebases None e-holdings, bibliographic Patron interfaces Browser-based Staff interfaces Graphical Desktop (Java Swing, Windows, Mac OS) Procurement models Purchase Purchase, license license Hosting option Local install, ASP Saas Only Interoperability Batch transfer, proprietary API Batch transfer, RESTful APIs, APIs (mostly RESTful) Products SirsiDynix Symphony, Millennium, Polaris Sierra, SirsiDynix Symphony/BLUEcloud, Polaris, Apollo WorldShare Management Services, Alma, ProQuest Intota, Sierra, Kuali OLE Development strategy Brownfield Greenfield (mixed)
Development Timeline for Library Services Platforms
Library Services Platform Installations Production installations as of December 2014 Product Installations 2014 Sales Sierra 495 123 Alma 406 43 WorldShare Management Services 303 79 Kuali OLE 2 10 Intota 21
Cycle of adoption and deployment Beginning of a new cycle of transition that will last a decade Development and beta phase complete Now in mass deployment phase Over the course of the next decade, academic libraries will replace their current legacy products with new platforms Not just a change of technology but a substantial change in the ways that libraries manage their resources and deliver their services
Trends in library resource discovery
Web-scale Index-based Discovery ILS Data Web-scale Index-based Discovery (2009- present) Digital Collections Search: Web Site Content Institutional Repositories Search Results Aggregated Content packages Consolidated Index … E-Journals Your title is covered up with the ILS data content – DISCO instead of Discovery Usage-generated Data Customer Profile Reference Sources Pre-built harvesting and indexing
Comprehensive Library Portal Integrated Library System Library Web site Subject Guides Article, Databases, E-Book collections Public Interfaces: Presentation Layer
Discovery Service Statistics Discovery Product 2010 2011 2012 2013 2014 Installed EBSCO Discovery Service 1774 2634 8246 Primo 506 111 101 98 88 1529 Encore 56 72 36 Summon 164 214 158 195 697 WorldCat Discovery 2085
Demise of the local catalog Many library services platforms do not include the concept of an online catalog dedicated to local physical inventory Designed for discovery services as public-facing interface Implication: Discovery service must incorporate detailed functionality for local materials and related services
Fully Integrated Strategy Library services Platform Index-based discovery service Integrated link resolution Shared e-resource knowledgebase Analytics available from back-end and discovery perspective
Split Management / Discovery Strategy Library Services Platform for management of print and electronic resources Separate index-based discovery Knowledge base probably provided through Library Services Platform Link Resolution separate from Discovery: how to perform smart linking? Export and sync resource records from management to discovery service API look-ups for resource availability and status Patron profile and services request split between discovery and resource management components
Empowering Discovery with Social Data
Social Media and Networks Engagement with social networks a global phenomenon Facebook – Twitter – Instagram -- Snapchat An essential element of the student experience How to infuse or adapt social characteristic into the academic experience
Social aspects of Library Resource Discovery Integrated features that enable users to interact socially with other patrons Rate content and share with communities Form social groups that share academic interests Reading clubs (Public library context) Identify items of interest based on ratings and referrals of other users
Social impact on scholarly publishing The impact of a research article has traditionally been measured through citations in other scholarly works Today, impact is also a factor of exposure in social networks Many scholars share references through Twitter and other general social network platforms Many other discipline-specific forums Alternative metrics of impact that include non- traditional references
Refining discovery socially Collect and take advantage of use data to help identify items of interest Tune relevancy rankings based on use data and social elements
Personalization Social networks set expectations for highly personalized services User profiles that set basic affiliations (major area of study, department, etc) Systems that learn about the patron’s interest with increased use of the system Searches performed, articles selected, etc Potential for discovery services blend individual and aggregated use data to deliver customized results and relevancy rankings
Example: bx: makes recommendations based on associations implied in OpenURL link server logs Important data held in selections made by researchers within a given search session. Identifies related materials not necessarily apparent by key words or subject term assignments.
Social vs Privacy Social features assume some degree of knowledge about a user Personal or categorical? Concern to protect privacy while leveraging social data or features Is it possible to fully anonymize personal data related to search behavior?
Privacy and security recommendations Respect the privacy of library users in all possible ways Possible to capture extensive information through readily available tools and technologies Encrypt search sessions. (data in motion) Encrypt stored patron details.
General Security concerns All library systems must follow industry standards for security Increasingly expected to encrypt all network traffic https or equivalent Security compliance certifications for data centers and hosted services
Beyond Library Discovery Discovery happens elsewhere
Discovery Beyond Library-provided Interfaces Reality that most discovery happens external to library Improve discoverability of library resources Locally: through incorporation of SEO and semantic encoding Especially schema.org Globally: OCLC, Google Scholar and other services
Discovery beyond Library Interfaces Improved performance of library content through Google Scholar Same expectations for transparency? Better exposure of library-oriented content Schema.org or other microdata formats Better exposure of scholarly resources Open access & Proprietary Embedded tools in other campus interfaces
Changing models of Resource Sharing
Progressive consolidation of library services Centralization of technical infrastructure of multiple libraries within a campus Resource sharing support Direct borrowing among partner institutions Shared infrastructure between institutions Examples: 2CUL (Columbia University / Cornell University) Orbis Cascade Alliance (37 independent colleges and universities to merge into shared LSP)
Integrated Library System Search: Bibliographic Database Library System Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Patrons use Circulation features to request items from other branches Model: Multi-branch Independent Library System Floating Collections may reduce workload for Inter-branch transfers
Consortial Resource Sharing System Search: Bibliographic Database Library System A Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Bibliographic Database Library System D Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility NCIP Resource Sharing Application Bibliographic Database Discovery and Request Management Routines Staff Fulfillment Tools Inter-System Communications NCIP SIP ISO ILL Z39.50 NCIP Bibliographic Database Library System B Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Bibliographic Database Library System E Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility NCIP NCIP Bibliographic Database Library System C Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility Bibliographic Database Library System F Branch 1 Branch 2 Branch 3 Branch 4 Branch 5 Branch 6 Branch 7 Branch 8 Holdings Main Facility NCIP NCIP
Bibliographic Database Shared Consortial ILS Search: Bibliographic Database Shared Consortia System Library 2 Library 3 Library 4 Library 5 Library 7 Library 8 Library 9 Library 10 Holdings Library 1 Library 6 Model: Multiple independent libraries in a Consortium Share an ILS ILS configured To support Direct consortial Borrowing through Circulation Module
Shared Infrastructure Common discovery Retention of local automation systems Technical complex with moderate operational benefits Common discovery + Resource Management Systems Shared Resource management with local discovery options
Moving toward Collaborative Infrastructure
Benefits of shared infrastructure Increased cooperation and resource sharing Collaborative collection management Lower costs per institution Greater universe of content readily available to patrons Avoid add-on components for union catalog and resource requests and routing
Large-scale Implementations Scale of any given project is no longer limited Multi-tenant systems are already supporting very large numbers of sites Shared implementation does not necessarily require more resources than separate ones
Orbis Cascade Alliance Campus Libraries 37 Aggregated Enrollment 258,000 Total Titles 9 million Total Items 28 million
WHELF Wales Higher Education Libraries Forum Institution Wales Higher Education Libraries Forum Institution Prior ILS Bib Records Aberystwyth University Voyager 677,846 Bangor & Glyndwr University Sierra 591,673 Cardiff University & Welsh National Health Service 856,381 Cardiff Metropolitan University Alto 269,965 National Library of Wales Virtua 6,643,696 Royal Welsh College of Music and Drama 53,544 Swansea University 738,399 University of South Wales Symphony 365,602 University of Wales Trinity St. David Horizon 637,326 Total 10,834,432
California State University Institution Titles Volumes Circulation Staff FTE Bakersfield 473,134 637,606 15,714 25 Channel Islands 100,433 255,594 24 Chico 850,000 1,265,907 32,182 59 Dominguez Hills 628,193 637,064 8,456 38 East Bay 944,415 1,139,057 33,491 43 Fresno 1,928,624 1,345,398 208,491 78 Fullerton 1,153,714 1,256,867 61,486 74 Humboldt 692,017 807,101 30,300 31 Long Beach 1,198,788 3,073,252 147,461 68 Los Angeles 926,498 983,229 35,665 48 Maritime Academy 42,854 154,820 5,439 8 Monterey Bay 277,228 333,982 27,768 16 Northridge 1,575,695 2,170,589 130,322 138 Pomona 776,251 1,058,236 43,514 Sacramento 1,189,093 1,415,562 98,675 66 San Bernardino 935,366 868,453 29,001 90 San Diego 2,340,641 2,513,984 46,402 106 San Francisco 1,524,464 1,677,437 89,161 89 San Jose 1,505,676 1,441,279 94,745 88 San Luis Obispo 805,508 724,531 38,895 62 San Marcos 441,812 538,203 17,071 47 Sonoma 506,040 585,082 191,187 34 Stanislaus 344,311 513,565 31,611 27 Total 21,160,755 25,396,798 1,417,037 1,307
Comparison of Projects Institution Volumes Libraries Harvard University 18,900,000 79 Orbis Cascade Alliance 28,000,000 66 WHELF 10,834,432 32 California State University 25,396,798 25 University of California 45,000,000 100
Questions and discussion