Collaborative Digital Preservation with LOCKSS Gail McMillan Digital Library and Archives, University Libraries Virginia Polytechnic Institute and State University TRLN LOCKSS Symposium University of North Carolina, Chapel Hill November 1, 2005

The MetaArchive of Southern Digital Culture is a collaborative venture of Emory University, Georgia Tech, Virginia Tech, Florida State University, Auburn University, University of Louisville, and the Library of Congress. The project is part of the National Digital Information Infrastructure and Preservation Program (NDIIPP) supported by the Library of Congress. / The ASERL-LOCKSS-ETD Initiative is a collaborative venture between the LOCKSS Program at Stanford University and the University Libraries of the Florida State University, Georgia Institute of Technology, University of Kentucky, University of Tennessee, Vanderbilt University, and the Virginia Polytechnic Institute and State University, to preserve electronic theses and dissertations.

Commonalities Belief in digital preservation strategy Trusted partners Standards Open source software Off-the-shelf hardware

NDIIPP: National Digital Information Infrastructure and Preservation Program Created by federal legislation in December 2000 Support preservation of significant “born-digital” content at risk Three areas of focus –Network of preservation partners –Architectural framework for preservation –Digital preservation research Primary outcomes for partnerships: –Identify and preserve significant content –Leverage resources, experience via collaboration –Promote standards and best practices

MetaArchive NDIIPP Network via Internet2 Auburn University Emory University Ga Tech Va Tech University of Louisville Florida State University DC NYC CH IN ATL FL Lambda Rail Abilene NetworkSOX Network MAX Network MAX Connection to Va Tech

Key Features of the MetaArchive of Southern Digital Culture Distributed preservation strategy Flexible organizational model Formal content selection process Capability for migrating archives Dark archiving strategy Low cost to deployment Self-sustaining incentives Simple preservation exchange mechanisms with the Library of Congress

MetaArchive Rights Issues Use of protected works generally will need to: Fit within an exception to the exclusive rights of owners, such as the “fair-use” doctrine or other provisions relating specifically to library copying and other activities Undergo an investigation to determine whether the work enjoys protection or lapsed into the public domain due to notice or renewal defects Occur as a result of permission from copyright owner(s) Constitute acceptable risk for the institution in potential absence of “clear” resolution

MetaArchive Collaboration CLOCKSS Collecting Lots of Copies Keeps Stuff Safe Diversifying LOCKSS –Software, hardware, collections, communities Study issues –Dynamic content –Format migration (next grant) Cooperative agreement model –Effective preservation network of broad digital content Communication –Telephone conference, video conference I2, iVocalize Chat/VOIP Room, Wiki, PhpCollab

ASERL Project Using LOCKSS to Preserve ETDs Suggested March 2005, call for volunteers May, first virtual meeting June 10; first harvest ____________ Test the use of LOCKSS to preserve electronic theses and dissertations –Available, restricted, and withheld from public access –Dark archive Volunteer institutions committed –Personnel –Time –Finances –Hardware

ASERL ETD LOCKSS Project Virginia Tech NC State Georgia Tech Florida State University of Miami University of Tennessee Vanderbilt University of Kentucky

Technical Infrastructure: Goals Build on successful LOCKSS open-source model Create dark archive for locally produced digital content Use off-the-shelf hardware Use open-source software Create ease of replication Demonstrate LOCKSS scalability Enable benefits of Internet2 network

MetaArchive Software Operating System –RedHat Linux Enterprise AS v. 3/4 Ease of update management and experience w/OS –Could easily work on other versions of Linux JAVA SDK –Also tested with CentOS Linux Distribution LOCKSS Content Ingestion/Replication –LOCKSS Daemon – 6-8 week updates w/RPM Conspectus Database –MySQL/PHP Interface Integrated with LOCKSS Plugin Registry MetaArchive Collection Description Metadata Schema

MetaArchive Hardware Off-the-Shelf Strategy –Dell/Intel Based Hardware Could easily be HP or SUN Intel Based Hardware etc. Could be old desktops w/large hard drives. –New Low Cost SATA SAN EMC AX100 –$4.00 per GB (already dropping in price)

Sample CLOCKSS Setups Enterprise (3TB) –Dell PowerEdge Server 1850 LOCKSS - $3500 –Dell PowerEdge Server 1850 Firewall - $2500 –Dell/EMC AX100 SAN (3TB) - $10,000 –RedHat Enterprise AS – = $100 –UPS - $700 –Server Rack - $1200 Grand Total - $16, –w/ Rack - $18, Desktop (200Gb) –Intel Based Desktop LOCKSS (200Gb) - $500 –Intel Based Desktop Firewall - $350 –CentOS Linux - $0 –UPS - $50 Grand Total - $900.00

Future Refinements Currently Testing Administrative Interface for LOCKSS Networks –Enables partners to verify ETD backup and LOCKSS quorum –Enables ingest control for preservation groups once OAI harvesting is setup and/or plugin is published International ETD LOCKSS storage nodes

NDLTD and LOCKSS “dedicated to … preservation … of electronic theses and dissertations.” NDLTD Board of Directors endorsed ASERL and MetaArchive approaches to digital preservation ETD-IPN: Electronic Thesis and Dissertation International Preservation Network