The LIBRARY of CONGRESS JISC-CNI Envisioning Future Challenges in Networked Information York, England July 6, 2006

NDIIPP The LIBRARY of CONGRESS NDIIPP: Key Challenges of Collaboration and Sustainability Laura E. Campbell Associate Librarian for Strategic Initiatives July 6, 2006

3# NDIIPP The LIBRARY of CONGRESS Background Created by federal legislation (PL ) in December 2000 Up to $175 million available with matching Guided by National Digital Strategy Advisory Board (NDSAB) Preserving Our Digital Heritage national NDIIPP plan approved December 2002

4# NDIIPP The LIBRARY of CONGRESS NDIIPP Vision To ensure access over time to a rich body of digital content through the establishment of a national network of committed partners.

5# NDIIPP The LIBRARY of CONGRESS Overall NDIIPP Goals Identify and preserve at-risk digital content Develop a national digital collection and preservation strategy Support development of improved tools, models, and methods for digital preservation Work with industry, concerned federal agencies, libraries, research institutions and not-for-profit entities

6# Key Challenges: U.S. Context for Digital Preservation Decentralized activities in many communities –Government at various levels –Universities –Non-profits –Corporations –Consortial domains (i.e., Earth scientists and climate data, Biologists and genomic data, etc.) Assorted mandates, objectives, approaches NDIIPP

7# Answering the Challenges LC/NDIIPP to help bring a national focus, encourage collaboration among communities LC is providing resources and leadership –Working with other institutions to develop common understanding Established Affinity Groups based on cross-cutting issues –Selection and Collection –Rights and Restrictions –Technical Architecture –Economic Sustainability NDIIPP

8# A Network of People An Architecture for Preservation NDIIPP

9# Working with Other Federal Agencies LC/NDIIPP works with the following agencies –National Archives and Records Administration (responsible for federal records) –National Science Foundation –Government Printing Office –National Library of Medicine –Institute of Museum and Library Services –National Agricultural Library –Department of Commerce/National Institute of Science and Technology –Office of Science and Technology Policy NDIIPP

10# International Context LC/NDIIPP engaged internationally: –Founding member of the International Internet Preservation Consortium –Allied with the Digital Preservation Coalition –Chief Executive of the British Library on NDIIPP advisory board –Consulted with many national libraries concerning digital preservation efforts NDIIPP

11# NDIIPP The LIBRARY of CONGRESS NDIIPP is a Portfolio of Activities Four areas of focus –Network of preservation partners –Architectural framework for preservation –Digital preservation research –Intellectual Property Two phases of investment –Phase I commenced 2004 –Phase II commenced 2006

12# NDIIPP The LIBRARY of CONGRESS A National Content Stewardship Network 8 Consortial Agreements with 36 Participants 10 Digital Preservation Grants 4 AIHT Participants 2 Technical Archiving and Testing Participants – Diego Supercomputer Center –Los Alamos National Lab Research Library 2 Developers of Preservation Business Models –Portico –LOCKSS/CLOCKSS 2 International Partnerships –Representing 12 other national libraries 19 Experts on the Section 108 Working Group

13# NDIIPP The LIBRARY of CONGRESS A National Content Stewardship Network NDIIPPs Network is comprised of 28 agreements and 67 institutions involved in the beginning stages of building a digital preservation strategy under the NDIIPP program as well as a major initiative to address needed changes to copyright law. Reflects distributed approach necessary for preserving the volume and complexity of digital content

14# NDIIPP The LIBRARY of CONGRESS Preserving At-Risk Content Content Experts providing insight into specific domain requirements Variety of content scope, e.g. –Public television (high-definition digital TV) –Materials relating to southern culture –Government and political web sites –Social science data –Geospatial data –Dot-com era business records

15# NDIIPP The LIBRARY of CONGRESS Preservation Research Grants Joint LC/NSF program funding cutting-edge research 10 grants across different areas, e.g. –Large-scale data repositories for oceanographic study data and MODIS satellite images –Video –Engineering and design data –Infrastructure and lifecycle issues, including data provenance and versioning –Incentives for data producers to create archive-ready datasets –

16# Archive Ingest and Handling Test –Harvard, Stanford, Johns Hopkins & ODU conducted ingest, export, format migration and exchange on a common archive Tools and protocols –Los Alamos National Lab Research Library developing tools and standards to package, disseminate and store e-journal content Repository and storage –San Diego Supercomputer Center building and testing utility and trust in a third-party repository –National Digital Newspaper Program building distributed content production and validation network and a central repository to preserve digital newspaper content over time –eDeposit through Copyright acquiring and preserving eJournal content from multiple sources in different formats Preservation Architecture Projects The LIBRARY of CONGRESS NDIIPP

17# NDIIPP The LIBRARY of CONGRESS Preservation Architecture Principles: –Support institutional relationships –Separate preservation and access –Construct modularly –Assemble over time, not all at once –Upgrade parts without disruption of the whole –Use broadly adoptable standards and protocols

18# NDIIPP The LIBRARY of CONGRESS Section 108 Study Group Working group sponsored by NDIIPP with Copyright Office –19 copyright experts – half from libraries, archives; half from various content industries Mission: –re-examine copyright exceptions applicable to libraries and archives in light of digital technologies –findings and recommendations on revising law –ensure appropriate balance among copyright interests and needs of libraries and archives in manner that best serves the national interest Submit report to Librarian of Congress by late 2006 Roundtables on preservation and eligibility held March 2006; written comments due April 17, 2006

19# NDIIPP The LIBRARY of CONGRESS Partnership Outcomes Identify and preserve significant at-risk content Leverage resources and experience through collaboration Learn how to build and sustain a national digital stewardship network Construct a technical infrastructure to support interoperability and preservation services Explore public policy issues Provide basis for 2010 report to Congress

20# NDIIPP The LIBRARY of CONGRESS Expanding partnerships to commercial content and technology companies –Preserving Creative America Encouraging development of repositories for state and local at-risk content Additional funding of NSF/LC Grants Additional business models Technical infrastructure projects to expand and sustain a preservation network Phase Two Investments

21# NDIIPP The LIBRARY of CONGRESS Preserving Creative America Engage the commercial sector Goals –Preserve at-risk digital cultural heritage collections Recorded sound; moving image; interactive/electronic games; still images –Encourage agreement on preservation standards & best practices –Support demonstration projects with new tools & services –Establish Public-Private partnership models

22# NDIIPP The LIBRARY of CONGRESS LC exploring how best to include the States within the scope of NDIIPP Focusing on significant and at-risk state government digital information, broadly defined Special attention on multi-state repositories Received 9 responses June 15, 2006 Funds awarded in September 2006 NDIIPP and the States

23# NDIIPP The LIBRARY of CONGRESS Establish a network of shareable storage –Support preservation strategies such as content exchange, syndicated storage and risk assessment Develop services to support preservation functions such as –Data replication –Risk assessment –Data integrity assurance –Content validation –Content exchange 25 Proposals received June 1, 2006 Technical Infrastructure Projects

24# Digital Universe

25# NDIIPP The LIBRARY of CONGRESS