Preserving Digital Collections for Future Scholarship Oya Y. Rieger Cornell University

Part 1: Cornell Case Study

CUL Special Funds: 15,000 books Microsoft Live Book, 100,000 books Google Book Search, 500,000 books

Part 2: Preservation

Why preserve? Long-term returns on our investment in print collections Long-term returns on our investment in print collections Users want content in digital format Users want content in digital format Significant costs – likelihood of a 2 nd round? Significant costs – likelihood of a 2 nd round? If not libraries, who will assume the stewardship role? If not libraries, who will assume the stewardship role?

Digital Preservation Managed activities to support the long-term maintenance of bitstreams to make sure that digital objects are usable Managed activities to support the long-term maintenance of bitstreams to make sure that digital objects are usable

Digital Preservation Managed activities to support the long-term maintenance of bitstreams to make sure that digital objects are usable Managed activities to support the long-term maintenance of bitstreams to make sure that digital objects are usable Ensuring the usability of a digital resource by retaining all quantities of authenticity, accuracy, and functionality Ensuring the usability of a digital resource by retaining all quantities of authenticity, accuracy, and functionality

Digital Preservation Managed activities to support the long-term maintenance of bitstreams to make sure that digital objects are usable Managed activities to support the long-term maintenance of bitstreams to make sure that digital objects are usable Ensuring the usability of a digital resource by retaining all quantities of authenticity, accuracy, and functionality Ensuring the usability of a digital resource by retaining all quantities of authenticity, accuracy, and functionality Envisioning & enabling new ways of scholarship based on digital content Envisioning & enabling new ways of scholarship based on digital content

Digital Preservation Program Organizational Infrastructure Organizational Infrastructure Technical Architecture Technical Architecture Resources Framework Resources Framework

Digital Preservation Program Organizational Infrastructure Organizational Infrastructure Technical Architecture Technical Architecture Resources Framework Resources Framework Access Vision Access Vision technology resources organization access

Organizational Infrastructure Preservation mandate & priorities Preservation mandate & priorities Policies for selecting, reselecting, and deselecting Policies for selecting, reselecting, and deselecting Technical requirements and best practices Technical requirements and best practices Training and professional development Training and professional development Provenance, authenticity, and integrity Intellectual property rights Collaboration Risk assessment Documentation

Technical Architecture Repository to ingest, monitor, manage, and archive Repository to ingest, monitor, manage, and archive Storage architecture Storage architecture Ingest workflow and quality control Ingest workflow and quality control Preservation metadata Preservation metadata Interoperability Interoperability Monitoring and management Preservation strategies Disaster-prevention & recovery Security measures Technical audits Technology forecasting

Resources Framework Storage architecture Storage architecture Primary Primary Secondary Secondary Programming & systems staff Programming & systems staff Preservation policy staff Preservation policy staff Network charges Sustainability Cost recovery PoD DoD

Access Vision Redundancy arrangements for access Redundancy arrangements for access Search engines Search engines Access to materials: Access to materials: Public domain Public domain Copyright Copyright New forms of scholarship Text mining Visualization Clustering New forms of publishing Social networking

Part 3: Recommendations

Reassess Digitization Requirements: Create a New Metrics Contemporary digitization technologies and image- processing tools Contemporary digitization technologies and image- processing tools New archival file formats, such as JPEG2000 and PDF/A New archival file formats, such as JPEG2000 and PDF/A Evolving access formats for sophisticated retrieval and use of content such as text mining Evolving access formats for sophisticated retrieval and use of content such as text mining The correlation between image quality and OCR accuracy The correlation between image quality and OCR accuracy

Enhance Access to Digitized Content Enduring access by enabling online discovery Enduring access by enabling online discovery Print preservation for materials in copyright Print preservation for materials in copyright Collaboration for aggregated or federated access Collaboration for aggregated or federated access Understand the impact of contractual restrictions on preservation responsibilities Understand the impact of contractual restrictions on preservation responsibilities Support new e-scholarship formats & applications Support new e-scholarship formats & applications

Outline an Archiving Action Agenda Defining minimum requirements necessary to facilitate shared storage and registry initiatives Defining minimum requirements necessary to facilitate shared storage and registry initiatives Making geographic data-redundancy arrangements Making geographic data-redundancy arrangements Implementing distributed and collaborative strategies (LOCKSS and Portico) Implementing distributed and collaborative strategies (LOCKSS and Portico) Sharing open-source preservation services Sharing open-source preservation services Exploring how usage statistics can inform preservation decisions Exploring how usage statistics can inform preservation decisions

Understand Costs Involved in Digital Preservation Efforts Significant local expenses by participating libraries Significant local expenses by participating libraries Building and managing a digital preservation infrastructure is neither easy nor cheap Building and managing a digital preservation infrastructure is neither easy nor cheap Share cost information – understand long-term implications Share cost information – understand long-term implications

Developing a Joint Agenda Institutional differences in opinion, funding models, digital library infrastructures, and strategic goals Institutional differences in opinion, funding models, digital library infrastructures, and strategic goals Cooperative efforts should not slow the community’s efforts, but rather complement the ongoing institutional programs Cooperative efforts should not slow the community’s efforts, but rather complement the ongoing institutional programs Join forces among cultural institutions & corporate partners to leverage resources, strengthen causes, control risks, and expand alternative strategies Join forces among cultural institutions & corporate partners to leverage resources, strengthen causes, control risks, and expand alternative strategies