A Practical, Working and Replicable Approach to ETD Preservation Catherine M. Jannik, Georgia Institute of Technology Robert H. McDonald, Florida State.

Slides:



Advertisements
Similar presentations
ETD Preservation Survey Results Gail McMillan Digital Library and Archives, Virginia Tech 11th International ETD Symposium Robert Gordon University.
Advertisements

Ensuring Long-term Access to ETDs through Distributed Digital Preservation Gail McMillan Director, Digital Library and Archives Virginia Tech Newcomers.
ETD Preservation Workshop Session Four: Collection Management for Preservation Gail McMillan, Virginia Tech.
ETD Preservation Workshop Session One: ETDs and Preservation Needs Gail McMillan, Virginia Tech.
Copying Archives Project Group Members: Mushashu Lumpa Ngoni Munyaradzi.
BUILDING A COLLABORATIVE DIGITAL PRESERVATION NETWORK Caroline Arms Office of Strategic Initiatives, Library of Congress Robert H. McDonald Associate Director.
Katherine Skinner Executive Director, Educopia Institute Program Manager, MetaArchive Cooperative An Age of Discovery, ARL-CNI Washington D.C. Friday,
Mairéad Martin, Penn State University Commons Solutions Group Storage Workshop May 2010.
Southeastern Digital Libraries: An Overview of Current Projects and Future Trends Toby Graham Director, Digital Library of Georgia Catherine M. Jannik.
ETD-db: Original ETD-db 2.0: Enhanced Gail McMillan Director, Digital Library and Archives, Virginia Tech and Edward A. Fox, Executive Director, NDLTD.
A Community Approach to Preservation: “Experiences with Social Science Data” Community Approaches to Digital Preservation 2009 Jonathan Crabtree February.
Distributed Digital Preservation Networks Across a Region, Across a State: Stretching LOCKSS Gail McMillan, Virginia Tech Martin Halbert, Emory Aaron Trehub,
MetaArchive of Southern Digital Cultural Partners in the dispersed redundant dark archive University Libraries at Emory Auburn Florida State Georgia Tech.
Rutgers University Libraries What is RUcore? o An institutional repository, to preserve, manage and make accessible the research and publications of the.
Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.
Collaborative Digital Preservation with LOCKSS Gail McMillan Digital Library and Archives, University Libraries Virginia Polytechnic Institute and State.
South Carolina Information Technology Directors Association September 8, 2008 Bill Henry, Matt Guzzi SC Department of Archives and History.
Collaborative Preservation of ETDs: The MetaArchive Cooperative and LOCKSS Gail McMillan Digital Library and Archives, Virginia Tech 1 st Canadian ETD.
Preservation Collaboration: NDLTD & MetaArchive Cooperative Gail McMillan Digital Library and Archives, Virginia Tech Newcomers’ ETDs 2010 University.
Data-PASS Shared Catalog Micah Altman & Jonathan Crabtree 1 Micah Altman Harvard University Archival Director, Henry A. Murray Research Archive Associate.
MetaArchive Distributed Digital Preservation Workshop Session 3: Costs and Operational Considerations Wednesday, May 30, 2007 Robert W. Woodruff Library.
MetaArchive of Southern Digital Cultural Partners in a dispersed redundant dark archive University Libraries at Emory Auburn Florida State Georgia Tech.
1.2 Content Management Catherine M. Jannik Georgia Institute of Technology MetaArchive Distributed Digital Preservation Workshop Emory University – Atlanta,
Michael Seadle “A Social Model for Archiving Digital Serials” Preprint available Sept. 14, 1006 at:
The ASERL LOCKSS-ETD INITIATIVE: Developing Preservation Strategies for Libraries that Publish E-Scholarship Robert H. McDonald – Florida State University.
Persistent Digital Archives and Library System (PeDALS) SC Department of Archives and History.
Digital Preservation through Cooperation: LOCKSS Gail McMillan Digital Library and Archives, University Libraries Virginia Polytechnic Institute and State.
Digital Preservation 101, or, How to Keep Bits for Centuries Julie C. Swierczek Digital Asset Manager and Digital Archivist Harvard Art Museums.
Electronic Thesis and Dissertation Initiative at Indiana State University(ISU) where to start and where to go Valentine Muyumba (Chair of Cataloging and.
Growing the MetaArchive Cooperative: ETDs (electronic theses and dissertations) Gail McMillan Digital Library and Archives, Virginia Tech July 2008 NDIIPP.
IUScholarWorks is a set of services to make the work of IU scholars freely available. Allows IU departments, institutes, centers and research units to.
Core Issues in Digital Preservation: Storage and Maintenance Jacob Nadal, Preservation Officer UCLA Library.
OAIS Open Archival Information System. “Content creators, systems developers, custodians, and future users are all potential stakeholders in the preservation.
Katherine Skinner Educopia Institute and MetaArchive Cooperative Matt Schultz Educopia Institute and MetaArchive Cooperative NDIIPP Partners Meeting Arlington,
Preserving ETDs: NDLTD & MetaArchive Collaboration Gail McMillan Digital Library and Archives, Virginia Tech Newcomers’ USETDA 2012.
1 NDLTD Welcome and Introduction ETD 2011: 14 th Int. Symp. on ETDs Cape Town, South Africa Edward A. Fox Executive Director, NDLTD,
National Digital Information Infrastructure and Preservation Program (NDIIPP) CNI Project Briefing December 5, 2005.
Plugin Lifecycle Andrew Fabian MetaArchive Annual Membership Meeting Atlanta, Georgia Friday October 24, 2008.
Preserving eScholarship and Digitized Special Collections Distributed Digital Preservation Bill Donovan
T HE M ETA A RCHIVE M ODEL : D ISTRIBUTED D IGITAL P RESERVATION N ETWORKS Dr. Martin Halbert VIVA/SCHEV LAC Meeting Christopher Newport University Trible.
Katherine Skinner, Executive Director, Educopia Institute ESOPI 2013 Chapel Hill, NC April 19, 2013.
Growing the MetaArchive Cooperative ETDs Gail McMillan Digital Library and Archives, Virginia Tech July 2008 NDIIPP Partners Meeting.
Report on Preservation of ETDs: The LOCKSS Prototype The work of Kamini Santhanagopalan Virginia Tech Graduate Student in Computer Science Reported at.
Martin Halbert President, MetaArchive Cooperative DigCCurr 2009 Meeting Chapel Hill, NC Friday, April 3, 2009.
Persistent Digital Archives and Library System (PeDALS)
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
How to Implement an Institutional Repository: Part II A NASIG 2006 Pre-Conference May 4, 2006 Technical Issues.
Collaborative Preservation of ETDs: The MetaArchive Cooperative and LOCKSS Gail McMillan Digital Library and Archives, Virginia Tech Canadian.
Katherine Skinner, Educopia Institute Emily Gore, Clemson University U.S. Workshop on Roadmap for Digital Preservation Interoperability Framework NIST,
Chronopolis – MetaArchive Improving and Strengthening Inter-Institutional Preservation.
DuraCloud Open technologies and services for managing durable data in the cloud Michele Kimpton, CBO DuraSpace.
Distributed Digital Preservation Networks Across a Region, Across a State: Stretching LOCKSS Gail McMillan, Virginia Tech Martin Halbert, Emory Aaron Trehub,
Digital Preservation through Cooperation: LOCKSS Gail McMillan Digital Library and Archives, University Libraries Virginia Polytechnic Institute and State.
ETDs and NDLTD Hussein Suleman University of Cape Town May 2004.
LOCKSS at Georgia Tech Patricia E. Kenly April 2007.
Digital preservation of CBUC theses with MetaArchive 11th SELL Meeting Porto, June 4th 2011.
Libraries in the digital age Collection & preservation for generational access part two The LOCKSS Program.
CMU Libraries’ Digital Assets Preservation Strategy Presenter Gabrielle V. Michalek Principal Archivist and Head, Archives/Digital Library Initiatives.
CLOCKSS Controlled LOCKSS (Lots of Copies Keep Stuff Safe) CEIRC Datasets Coordinators Forum Melbourne 4 February 2008.
Beyond Technology: Creating and Sustaining the MetaArchive Cooperative Joint Annual Meeting, Society of American Archivists & the Council of State Archivists.
Building A Repository for Digital Objects
Implementing Metaarchive At Robert E. Kennedy Library
Statewide Digitization and the FCLA Digital Archive
Implementing an Institutional Repository: Part II
ETD Preservation Survey Results
Gail McMillan Digital Library and Archives, Virginia Tech
Institutional Repositories
Implementing an Institutional Repository: Part II
The MetaArchive Model: Distributed Digital Preservation Networks
How to Implement an Institutional Repository: Part II
Presentation transcript:

A Practical, Working and Replicable Approach to ETD Preservation Catherine M. Jannik, Georgia Institute of Technology Robert H. McDonald, Florida State University Gail McMillan, Virginia Polytechnic Institute and State University 8th International Symposium on Electronic Theses and Dissertations, Sept. 29, 2005

The MetaArchive Project is a collaborative venture of Emory University, Georgia Tech, Virginia Tech, Florida State University, Auburn University, University of Louisville, and the Library of Congress. The project is part of the National Digital Information Infrastructure and Preservation Program (NDIIPP) supported by the Library of Congress. The ASERL-LOCKSS-ETD Initiative is a joint project between the LOCKSS (Lots of Copies Keep Stuff Safe) Program at Stanford University and the University Libraries of the Florida State University, Georgia Institute of Technology, University of Kentucky, University of Tennessee, Vanderbilt University, and the Virginia Polytechnic Institute and State University.

Key Features of the MetaArchive of Southern Digital Culture  Distributed preservation strategy  Flexible organizational model  Formal content selection process  Capability for migrating archives  Dark archiving strategy  Low cost to deployment  Self-sustaining incentives  Simple preservation exchange mechanisms

"...let us save what remains: not by vaults and locks which fence them from the public eye and use in consigning them to the waste of time, but by such a multiplication of copies, as shall place them beyond the reach of accident." Thomas Jefferson, 1791

Distributed Archiving Strategies LOCKSS for Electronic Journals LOCKSS for ETDs

LOCKSS for Electronic Journals

LOCKSS for Electronic Journals

LOCKSS for ETDs Virginia Tech NC State Georgia Tech Florida State University of Miami University of Tennessee Vanderbilt University of Kentucky

LOCKSS for ETDs Virginia Tech NC State Georgia Tech Florida State University of Miami University of Tennessee Vanderbilt University of Kentucky

Technical Infrastructure Overall Goals of TI –Build on successful LOCKSS open-source model –Create dark archive for locally produced digital content –Use off-the-shelf hardware –Use open-source software (currently all) –Create ease of replication –Demonstrate LOCKSS scalability –Enable benefits of Internet2 network

LOCKSS and the OAIS Framework

Hardware Off-the-Shelf Strategy –Dell/Intel Based Hardware Could easily be HP or SUN Intel Based Hardware etc. Could be old or new desktops w/large hard drives. –New Low Cost SATA SAN EMC AX100 –$4.00 per GB (already dropping in price)

Software Operating System –RedHat Enterprise Linux AS v. 4 Ease of update management and experience w/OS –Setup can easily be set up on other versions of Linux using kickstart configuration. JAVA SDK –Also tested with CentOS Linux Distribution LOCKSS Content Ingestion/Replication –LOCKSS Daemon – 6-8 week updates w/RPM files produced by LOCKSS. Conspectus Database –MySQL/PHP Web Interface – Integrated with LOCKSS Plugin Registry – Viewable to all - Editable by Members MetaArchive Collection Description Metadata Schema

Standards OAIS Reference Model –LOCKSS Compliance (Pull Methodology) Multiple Submission Information Package (SIP) Model –OAI-PMH 2.0 Using as alternative to current LOCKSS AU strategy –LOCKSS Audit Procedure Modified UKOLN RSLP Collection Description –Basis for MetaArchive Collection Conspectus

EXAMPLE SETUP Enterprise (3TB) –Dell PowerEdge Server 1850 LOCKSS - $3500 –Dell PowerEdge Server 1850 Firewall - $2500 –Dell/EMC AX100 SAN (3TB) - $10,000 –RedHat Enterprise AS – = $100 –UPS - $700 –Server Rack - $1200 Grand Total - $16, –w/ Rack - $18, Desktop (200Gb) –Intel Based Desktop LOCKSS (200Gb) - $500 –Intel Based Desktop Firewall - $350 –CentOS Linux - $0 –UPS - $50 Grand Total - $900.00

MetaArchive Network via Internet2 Auburn University Emory University Ga Tech Va Tech University of Louisville Florida State University DC NYC CH IN ATL FL Lambda Rail (RON) Abilene Network (I2)SOX Network (RON) MAX Network (RON) MAX Connection to Va Tech

Future Refinements Currently Testing Administrative Interface for LOCKSS Networks –Enables Partners to Verify ETD Backup and LOCKSS Quorum –Enables Ingest Control for preservation groups once OAI Harvesting is setup and or Plugin is Published International ETD LOCKSS Storage Nodes

LOCKSS ADMIN INTERFACE for METAARCHIVE NETWORK

NDLTD and LOCKSS Call for Participation Why not an Electronic Thesis and Dissertation International Preservation Network (ETD-IPN)? NDLTD Board of Directors –Tell them you endorse this initiative. or

Further Reading Consultative Committee for Space Data Systems (CCSDS). (2002). Reference Model for an Open Archival Information System (OAIS), Blue Book, Issue 1, January 2002, ISO 14721: DS B-1.pdf DS B-1.pdf Rosenthal et. al. Requirements for Digital Preservation Systems: A Bottum-Up Approach RLG-OCLC. (2002). Trusted Digital Repositories: Attributes and Responsibilities. Mountain View, CA.