Katherine Skinner, Martin Halbert & Matt Schultz Educopia Institute and MetaArchive Cooperative NDSA Infrastructure Committee 02-17-2011.

Slides:



Advertisements
Similar presentations
Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.
Advertisements

Katherine Skinner Executive Director, Educopia Institute Program Manager, MetaArchive Cooperative An Age of Discovery, ARL-CNI Washington D.C. Friday,
The National Digital Stewardship Alliance: Community, Content, Commitment.
Mairéad Martin, Penn State University Commons Solutions Group Storage Workshop May 2010.
Trustworthy repository criteria, virtual organizations, and infrastructure Chronopolis.
TRAC / TDR ICPSR Trustworthy Digital Repositories.
Rutgers University Libraries What is RUcore? o An institutional repository, to preserve, manage and make accessible the research and publications of the.
Collaborative Preservation of ETDs: The MetaArchive Cooperative and LOCKSS Gail McMillan Digital Library and Archives, Virginia Tech 1 st Canadian ETD.
An Overview of Selected ISO Standards Applicable to Digital Archives Science Archives in the 21st Century 25 April 2007 Donald Sawyer - NASA/GSFC/NSSDC.
Toward a Distributed and Collaborative Framework for Preservation Martin Halbert, UNT Dean of Libraries David Minor, Chronopolis Program Manager Katherine.
MetaArchive Distributed Digital Preservation Workshop Session 3: Costs and Operational Considerations Wednesday, May 30, 2007 Robert W. Woodruff Library.
T OWARD A C OLLABORATIVE A PPROACH TO S TAKEHOLDERS ’ I NVOLVEMENT IN ETD S C URATION Presenters: Daniel Gelaw Alemneh, Geneva Henry, & Shannon Stark L.
Mid-Michigan Digital Practitioners, March 14, 2014 The National Digital Stewardship Alliance Agenda Mid-Michigan Digital Practitioners Meeting Abigail.
International Council on Archives Section on University and Research Institution Archives Michigan State University September 7, 2005 Preserving Electronic.
Science Archives in the 21st Century 25/26 April Towards an International standard for Audit and Certification of Digital Repositories David Giaretta.
World Data Center for Human Interactions in the Environment Conducting a Self-Assessment of a Long-Term Archive for Interdisciplinary Scientific Data as.
Tyler Walters Dean, University Libraries and Professor Virginia Tech July 18, 2013 Collaboratively Preserving Our Digital Memory.
DuraSpace Summit meeting Baltimore, Md March 13,
Katherine Skinner, Executive Director, Educopia Institute Martin Halbert, Dean of Libraries, University of North Texas CNI 2010 Spring Forum, Baltimore.
Preserving Digital Collections for Future Scholarship Oya Y. Rieger Cornell University
Texas Digital Library CENTRAL TEXAS AND SAN ANTONIO-AREA REGIONAL MEETING SEPTEMBER 5, 2013.
OAIS Open Archival Information System. “Content creators, systems developers, custodians, and future users are all potential stakeholders in the preservation.
NDIIPP The Next Phase Meg Williams Associate General Counsel The Library of Congress.
Katherine Skinner Educopia Institute and MetaArchive Cooperative Matt Schultz Educopia Institute and MetaArchive Cooperative NDIIPP Partners Meeting Arlington,
Preserving ETDs: NDLTD & MetaArchive Collaboration Gail McMillan Digital Library and Archives, Virginia Tech Newcomers’ USETDA 2012.
DigCCurr Professional Institute: Curation Practices for the Digital Object Lifecycle Digital Curation Program Development Nancy Y McGovern Research Assistant.
Katherine Skinner, Emory University Gail McMillan, Virginia Tech NDIIPP Annual Partners Meeting June 24, 2009.
1 Designing Storage Architecture for Digital Collections 2012.
Martin Halbert UNT Dean of Libraries MetaArchive President Monday, April 11, 2011 Newspaper Archive Summit University of Missouri Columbia, MO.
Preserving eScholarship and Digitized Special Collections Distributed Digital Preservation Bill Donovan
Digital Preservation MetaArchive Cooperative.  9:00-9:45 - Session 1: Digital Preservation Overview  9:45-11:00 - Session 2: Policy & Planning Overview.
T HE M ETA A RCHIVE M ODEL : D ISTRIBUTED D IGITAL P RESERVATION N ETWORKS Dr. Martin Halbert VIVA/SCHEV LAC Meeting Christopher Newport University Trible.
Katherine Skinner, Executive Director, Educopia Institute ESOPI 2013 Chapel Hill, NC April 19, 2013.
Session 3.  Now you know WHY to make policies and WHAT they should contain…  But HOW do you implement policies?  And then HOW do you implement a program.
Developing strong data roots in fertile library soil: e-science in canadian libraries Geoff Harder Canadian eResearch Community, CLA, 2013.
Martin Halbert President, MetaArchive Cooperative DigCCurr 2009 Meeting Chapel Hill, NC Friday, April 3, 2009.
Developments in long term preservation LIBER 2012, Marcel Ras.
Dr. Martin Halbert Dr. Katherine Skinner Digital Preservation: What’s Now, What’s Next. Amigos Online Conference, August 12, 2011.
UK LOCKSS Alliance: Investigation into Private LOCKSS Networks Adam Rusbridge EDINA, University of Edinburgh.
How to Implement an Institutional Repository: Part II A NASIG 2006 Pre-Conference May 4, 2006 Technical Issues.
Funded by: © AHDS Preservation in Institutional Repositories Preliminary conclusions of the SHERPA DP project Gareth Knight Digital Preservation Officer.
MetaArchive Cooperative Annual Membership Meeting Welcome & Overview Dr. Martin Halbert, President MetaArchive Annual Membership Meeting Houston, TX Friday,
NDSR Boston webinar: Digital Preservation Introduction Presenter: Nancy Y McGovern October 2015.
Katherine Skinner, Educopia Institute Emily Gore, Clemson University U.S. Workshop on Roadmap for Digital Preservation Interoperability Framework NIST,
Chronopolis – MetaArchive Improving and Strengthening Inter-Institutional Preservation.
The Project Three-year grant from the National Historical Publications and Records Commission (NHPRC), April 2010-March 2013 Develop electronic records.
PLN Members and the ARL Digital Preservation Survey Preliminary Findings Gail McMillan Director, Digital Library and Archives Virginia Tech Matt Schultz,
Martin Halbert MetaArchive Cooperative Thursday, June 25, 2009 NDIIPP Annual Meeting Washington, D.C.
APPLYING OAIS TO DISTRIBUTED DIGITAL PRESERVATION Katherine Skinner, Eld Zierau IDCC Workshop, Amsterdam, January 14, 2013.
Aligning Digital Preservation Policies with Community Standards Nancy McGovern Digital Preservation Officer.
Distributed Digital Preservation Networks Across a Region, Across a State: Stretching LOCKSS Gail McMillan, Virginia Tech Martin Halbert, Emory Aaron Trehub,
Custodians of Culture, Architects of Archives  Martin Halbert (Emory Univ., MetaArchive Cooperative) - Facilitator  Thib Guicherd ‐ Callin (Stanford.
Institutional Repositories July 2007 DIGITAL CURATION creating, managing and preserving digital objects Dr D Peters DISA Digital Innovation South.
Data Management and Digital Preservation Carly Dearborn, MSIS Digital Preservation & Electronic Records Archivist
A Shared Commitment to Digital Preservation and Access.
Digital Preservation MetaArchive Cooperative, Digital Preservation Policy Planning Workshop Boston College, Boston, MA October 26, 2010.
The National Digital Stewardship Alliance: Community, Content, Commitment.
Digital Preservation MetaArchive Cooperative, Digital Preservation Policy Planning Workshop Boston College, Boston, MA October 26, 2010.
CESSDA SaW Training on Trust, Identifying Demand & Networking
Digital Libraries: Planning, Creating, Collaborating, & Reality
Implementing Metaarchive At Robert E. Kennedy Library
Trustworthiness of Preservation Systems
Denise Koufogiannakis Chair, Steering Committee
Joseph JaJa, Mike Smorul, and Sangchul Song
Implementing an Institutional Repository: Part II
Research data preservation in Canada
Implementing an Institutional Repository: Part II
The MetaArchive Model: Distributed Digital Preservation Networks
How to Implement an Institutional Repository: Part II
Presentation transcript:

Katherine Skinner, Martin Halbert & Matt Schultz Educopia Institute and MetaArchive Cooperative NDSA Infrastructure Committee

 A distributed digital preservation cooperative for digital archives, based on LOCKSS  286 TB network with 24 secure caches  Preserving collections for/with 18 members and 46 institutions in 4 countries  Actively growing (4 new members this fall, including two consortia with 30 members)  Provide preservation consulting and training 2 Skinner, Halbert & Schultz 02/17/11

 Founded on the premise that cultural memory organizations should maintain their historical role as cultural stewards  Preservation of digital assets as corollary to preserving physical ones  Need in house expertise and knowledge  Value of curators and librarians and archivists  Chose technical and organizational infrastructure that capitalizes on cultural memory organization’s proven methodologies  Distributed preservation  Partnership to keep costing affordable 3 Skinner, Halbert & Schultz 02/17/11

 Compatible with any repository/content management system  Three membership levels  Preservation members: $3,000K/yr  Sustaining members: $5,500K/yr  Collaborative members: $2,500/yr plus $100/yr per participating institution  Server cost: $4,600/3 yrs  Storage cost: $1/GB/yr 4 Skinner, Halbert & Schultz 02/17/11

 Undertake a 3-year membership term;  Take responsibility for content preparation, evaluation, staging, and plugin development;  Host and maintain a MetaArchive cache. 5 Skinner, Halbert & Schultz 02/17/11

 Advises, assists, and evaluates member plugins/collections to ensure accurate ingests;  Hosts centralized infrastructure for the network;  Monitors network and content;  Provides ongoing reports to members;  Performs format migrations when needed;  Retrieval of member content on demand 6 Skinner, Halbert & Schultz 02/17/11

7 Producer collaborates with MetaArchive staff to prepare content from any framework (e.g. Dspace, Fedora, CONTENTdm, ETDdb, etc). Producer ingests content into a test network where it is extensively tested for web-crawl accuracy before it is released for production Producer and MetaArchive staff agree that the content is ready for ingest. MetaArchive staff select 7 caches for preservation replications (based on geographical dispersal and space considerations) Each cache regularly returns to the Producer’s master site to ingest new versions as they become available. All versions are preserved.

8 All caches are connected

9 Success = compatible hash value

 Data preparation  Replication  Geographical Distribution  Bit Integrity Checking  Versioning  Security  Restricted Viewing  Content Restoration 10

 Completed self-audit with external auditor in 2010 (see )  MetaArchive successfully conforms in all 3 categories and 84 criteria  “trustworthy digital repository”…ensures that processes and policies and workflows meet the standard for long-term preservation  Helped us identify places where we could improve our policies and documentation 11 Skinner, Halbert & Schultz 02/17/11

 TRAC audit also showed us the need for articulating DDP in OAIS terms: ▪ Bridging terminology ▪ Expanding on functional areas ▪ Describing roles and responsibilities  Core topic of PLN 2010 Conference ▪ Working Group formed: Library of Congress, LOCKSS, DataPASS, PeDALS, and MetaArchive 12 Skinner, Halbert & Schultz 02/17/11

 Not another Reference Model  Abstraction of OAIS – similar to PAIMAS  Describing a Framework for Applying OAIS to DDP  1-2 Year Project – Three Phases ▪ Research & Recruitment: GAP Analysis White Paper (OAIS Section 6 & Use Cases) ▪ Production: Collaborative drafting of Framework (modeled on PAIMAS) ▪ Dissemination: Submission to CCSDS and promotion in the DP community 13 Skinner, Halbert & Schultz 02/17/11

 Intended Outcomes ▪ Enlarging the community’s understanding of distributed digital preservation concepts & approaches ▪ Guidance on trustworthy digital preservation activities for DDP developers & practitioners ▪ Effectiveness for auditing DDP preservation solutions 14 Skinner, Halbert & Schultz 02/17/11

 Balance of flexibility and fragility  Strong organizational center  Limited dependence on any one member  Collaborative model for long-term preservation  Geographic diversity/distribution  Expertise diffusion  Maintain cost-effective, in-house options Skinner, Halbert & Schultz 02/17/11 15

 Outsourcing core services = risky proposition  Core missions:  Building collections  Disseminating collections  Preserving collections Cannot focus on the collections at the expense of the services … need both in order to carry our missions and memory forward 16 Skinner, Halbert & Schultz 02/17/11

Dr. Katherine Skinner Dr. Martin Halbert Matt Schultz 17 Skinner, Halbert & Schultz 02/17/11