ISO 16363 & OAI-PMH By Neal Harmeyer, Amy Hatfield, and Brandon Beatty PURDUE UNIVERSITY RESEARCH REPOSITORY.

Slides:



Advertisements
Similar presentations
Long-Term Preservation. Technical Approaches to Long-Term Preservation the challenge is to interpret formats a similar development: sound carriers From.
Advertisements

An Introduction to Repositories Thornton Staples Director of Community Strategy and Alliances Director of the Fedora Project.
October 28, 2003Copyright MIT, 2003 METS repositories: DSpace MacKenzie Smith Associate Director for Technology MIT Libraries.
The future’s so bright…. DAITSS DIGITAL PRESERVATION SYSTEM: RE-ARCHITECTED, RE- WRITTEN, AND OPEN SOURCE Priscilla Caplan Florida Center for Library Automation.
Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.
An Introduction June 17, 2013 Open Archival Information System (OAIS)
Institutional Repositories It’s not Just the Technology New England Archivists Boston College March 11, 2006 Eliot Wilczek University Records Manager Tufts.
Digital Preservation - Its all about the metadata right? “Metadata and Digital Preservation: How Much Do We Really Need?” SAA 2014 Panel Saturday, August.
Transformations at GPO: An Update on the Government Printing Office's Future Digital System George Barnum Coalition for Networked Information December.
1 Archiving Workflow between a Local Repository and the National Library Archive Experiences from the DiVA Project Eva Müller, Peter Hansson, Uwe Klosa,
Merrilee Proffitt e(X)literature / Digital Cultures Project April 2003 News from the Digital Library The Metadata Encoding and Transmission Standard; the.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation Mike Smorul, Joseph JaJa, Yang Wang, and Fritz McCall.
OCLC Online Computer Library Center OCLC’s Digital Archive – Disseminating with METS Jay Goodkin Software Engineer Digital Collection and Preservation.
An Overview of Selected ISO Standards Applicable to Digital Archives Science Archives in the 21st Century 25 April 2007 Donald Sawyer - NASA/GSFC/NSSDC.
THE PURDUE UNIVERSITY RESEARCH REPOSITORY: HUBZERO CUSTOMIZATION FOR DATASET PUBLICATION AND DIGITAL PRESERVATION Amy Barton, MLS Assistant Professor of.
Metadata for preservation Michael Day, UKOLN, University of Bath Chinese-European Workshop on Digital Preservation,
Ingest and Dissemination with DAITSS Presented by Randy Fischer, Programmer, Florida Center for Library Automation, University of Florida DigCCurr2007.
Statewide Digitization and the FCLA Digital Archive Priscilla Caplan, Florida Center for Library Automation Statewide Digitization Planners Meeting OCLC,
PeDALS Persistent Digital Archives & Library System Richard Pearce-Moses Deputy Director for Technology & Information Resources Arizona State Library,
International Council on Archives Section on University and Research Institution Archives Michigan State University September 7, 2005 Preserving Electronic.
1 A journey of a thousand miles begins with a single step. Chinese Proverb.
How to build your own Dark Archive (in your spare time) Priscilla Caplan FCLA.
1 XML as a preservation strategy Experiences with the DiVA document format Eva Müller, Uwe Klosa Electronic Publishing Centre Uppsala University Library,
A disaggregated model for preservation of E-Prints Gareth Knight SHERPA DP Project Arts and Humanities Data Service.
Reference Model for an Open Archival Information System (OAIS) ESIP Summer Meeting John Garrett – ADNET Systems at NASA/GSFC ESIP Summer Meeting.
DAITSS: Dark Archive in the Sunshine State Priscilla Caplan, Florida Center for Library Automation DCC Workshop on Long-term Curation within Digital Repositories.
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
Implementor’s Panel: BL’s eJournal Archiving solution using METS, MODS and PREMIS Markus Enders, British Library DC2008, Berlin.
The FCLA Digital Archive Joint Meeting of CSUL Committees, 2005.
Digital Preservation: Current Thinking Anne Gilliland-Swetland Department of Information Studies.
Linked Digital Archive Institutional Repository Rathachai Chawuthai CSIM/SET/AIT.
Small steps and lasting impact: making a start with preservation or It’s not all NASA Patricia Sleeman Digital Archives and Repositories University of.
Archival Workshop on Ingest, Identification, and Certification Standards Certification (Best Practices) Checklist Does the archive have a written plan.
ETD2006 Preserving ETDs With D.A.I.T.S.S. FLORIDA CENTER FOR LIBRARY AUTOMATION FC LA PAPER AUTHORS: Chuck Thomas Priscilla.
Integrating metadata schema registries with digital preservation systems to support interoperability Michael Day UKOLN, University of Bath, UK
Metadata for digital preservation: a review of recent developments Michael Day UKOLN, University of Bath ECDL2001, 5th European Conference.
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
How to Implement an Institutional Repository: Part II A NASIG 2006 Pre-Conference May 4, 2006 Technical Issues.
Funded by: © AHDS Preservation in Institutional Repositories Preliminary conclusions of the SHERPA DP project Gareth Knight Digital Preservation Officer.
DAITSS: Dark Archive in the Sunshine State Priscilla Caplan Florida Center for Library Automation (FCLA)
Metadata “Data about data” Describes various aspects of a digital file or group of files Identifies the parts of a digital object and documents their content,
Fedora and the Preservation of University Electronic Records Project NHPRC Electronic Records Research Grant Kevin L. Glick Manuscripts and Archives, Yale.
The OAIS Reference Model Michael Day, Digital Curation Centre UKOLN, University of Bath Reference Models meeting,
Sharing Digital Scores: Will the Open Archives Initiative Protocol for Metadata Harvesting Provide the Key? Constance Mayer, Harvard University Peter Munstedt,
DAITSS and the Florida Digital Archive Priscilla Caplan Florida Center for Library Automation iPRES 2006.
ARIADNE is funded by the European Commission's Seventh Framework Programme Archiving and Repositories Holly Wright.
Lifecycle Metadata for Digital Objects November 15, 2004 Preservation Metadata.
Open Access & Institutional Repositories, Accra June 2007 Metadata and e-preservation Dr D Peters DISA: Digital Innovation South Africa.
The OAIS Reference Model and Trustworthy Repositories Josh Lubell Manufacturing Engineering Laboratory NIST
Institutional Repositories July 2007 DIGITAL CURATION creating, managing and preserving digital objects Dr D Peters DISA Digital Innovation South.
The OAIS model SEEDS meeting May 5 th, 2015, Lausanne Bojana Tasic.
Cedars work on metadata Michael Day UKOLN, University of Bath Cedars Workshop Manchester, February 2002.
Describing resources II: Dublin Core CERN-UNESCO School on Digital Libraries Rabat, Nov 22-26, 2010 Annette Holtkamp CERN.
Data Management and Digital Preservation Carly Dearborn, MSIS Digital Preservation & Electronic Records Archivist
OAIS (archive) Producer Management Consumer. Representation Information Data Object Information Object Interpreted using its Yields.
Digital Preservation What, Why, and How? Dan Albertson’s Digital Libraries Class April 13, 2016 Jody DeRidder Head, Metadata & Digital Services University.
OAIS (archive) OAIS (archive) Producer Management Consumer.
Joint Meeting of CSUL Committees,
Ingest and Dissemination with DAITSS
Building A Repository for Digital Objects
DAITSS and the Florida Digital Archive
An Overview of Data-PASS Shared Catalog
An Introduction to Tessella and The Safety Deposit Box Platform
Document, Index, Discover, Access
Statewide Digitization and the FCLA Digital Archive
Building Up the Strategic Components for Digital Preservation Policy
Research data preservation in Canada
Open Archival Information System
Robin Dale RLG OAIS Functionality Robin Dale RLG
Presentation transcript:

ISO & OAI-PMH By Neal Harmeyer, Amy Hatfield, and Brandon Beatty PURDUE UNIVERSITY RESEARCH REPOSITORY

PRESERVATION BY NEAL HARMEYER

WHY PRESERVE? Scholarly research necessitates ability to refer back, or build upon, previous work—without preservation, this becomes impossible over time. Items accessible today are not guaranteed to be accessible tomorrow. Obsolescence, technology failures, disasters, etc. can damage or destroy—effective preservation mitigates that eventuality.

PURR DIGITAL PRESERVATION POLICY The PURR Digital Preservation Policy is a guiding document for the management of content within the repository. The Policy states that a focused attention to preservation is an “essential component of PURR services as it enables long-term access, and as such it requires attention throughout the data management process.” Development of long-term preservation strategies, strategic plans, and actions are taken from this foundational document. The Libraries is committed to preserving and maintaining all PURR content for at least a period of ten years after it is published within the repository.

FROM POLICY TO TRUSTWORTHINESS Via the mandate of the PURR Digital Preservation Policy, a robust preservation system must be implemented. Stringent preservation planning should come from an internationally recognized standard. ISO 16363, Audit and Certification of Trustworthy Digital Repositories, provides metrics designed to establish a functional and reliable digital preservation environment.

DOCUMENTATION – PLAN AND STRATEGIES Preservation Strategic Plan Lays out overall objectives Lists imperative preservation activities Preservation Strategies Determines specific strategies for preservation of digital objects Lists preservation actions necessary for long-term preservation and access

DOCUMENTATION - OAIS MODEL The Open Archival Information System (OAIS) Reference Model is a standard in digital preservation. Various preservation planning aspects – ingest, data management, archival storage, and access – are modeled. The goal is to create a trustworthy system from producer to consumer.

DOCUMENTATION – FIXITY AND FORMATS Digital objects must undergo fixity checks on a regular basis. At ingest, a cryptographic hash is created for each object. On a set schedule, the current hash is compared to preservation hash to check fixity. File formats must be determined and validated to ensure long- term preservation techniques are appropriately applied. Files are checked against a format registry database at submission. Preservation strategies and actions are determined by file format. Formats are normalized to archival standards. As archival best practices change, preservation actions will change.

DOCUMENTATION – INFORMATION PACKAGES An information package is a group of digital objects within a preservation system. There are three types of information packages. Submission Information Package (SIP) –Delivered by producer and initiated when user creates a project –Includes: digital object(s), descriptive information (metadata) Archival Information Package (AIP) –Created from SIP –Contains digital object(s) and Preservation Descriptive Information (more metadata) Dissemination Information Package (DIP) –Derived from AIP –Access piece for consumer upon request

METADATA

Amy Hatfield, MLS PURR Metadata Puurrrrrrrrrrrrr……

Database population

DUBLIN CORE

QUALIFIED DUBLIN CORE SCHEMA DCTERMS NAME SPACE Principle Author - Required Other Authors - Optional/Repeatable Submission Timestamp (ISO 8601) - Required Abstract - Currently Required/Repeatable Synopsis - Currently Required/Repeatable Notes - Currently Required/Repeatable BagIt - Hard coded - Required DOI - Required Purdue University Research Repository - Hard coded - Required Information about rights held in and over the resource Tags - Required/Repeatable Required Dataset - Hard coded - Required

IMPLEMENTATION

<mets:mets… Principle Author - Required Other Authors - Optional/Repeatable Submission Timestamp - Required Abstract - Optional/Repeatable Synopsis - Optional/Repeatable Notes - Optional/Repeatable Bagit - Hard coded DOI - Required Purdue University Research Repository - Hard coded Information about rights held in and over the resource Tags - Optional/Repeatable Required Dataset - Hard coded Dublin Core Terms Metadata Encoding and Transmission Standard (METS) Wrapper

<mets:mets… PREMIS Preservation Metadata Administrative Metadata CHECKSUM - Required Generated checksum full Name of CHECKSUM algorithm Generated checksum PURR File format If the format is versioned, formatVersion should be recorded. It can be either a numeric or chronological designation. DROID or Unix Tools? (e.g., fmt/10) specification

<mets:mets… Software used to create the file. Repeatable for multiple software used. Software version Technical Metadata

<mets:mets… Technical Metadata Name of hardware Processor (e.g., 60 mhz minimum) (e.g., 64 MB RAM) Memory (e.g., 32 MB minimum)

<mets:mets… validation T00:00: jhove1_1e - validation software successful Well-formed and valid Provenance Metadata

<mets:mets… migration T00:00: Name of software used to migrate version (e.g., Adobe Acrobat v. 9) successful Provenance Metadata ingestion T00:00: Ingest tool/software (e.g., ingester1_0.exe) successful

Archival Information Package (AIP) PURR Puuuurrrrrrrrrrr…. Dissemination Information Package (DIP)

Searchable – within PURR Discoverable – through other systems… Dissemination Information Package (DIP )

OAI-PMH OPEN ARCHIVES INITIATIVE PROTOCOL FOR METADATA HARVESTING

OAI-PMH OPEN ARCHIVES INITIATIVE PROTOCOL FOR METADATA HARVESTING Application-independent framework based on metadata harvesting. There are two classes of participants in the OAI-PMH framework: Data Providers administer systems that support the OAI-PMH as a means of exposing metadata; and Service Providers use metadata harvested via the OAI-PMH as a basis for building value-added services.

OAI-PMH XML OUTPUT HUBNAME.ORG/?OPTION=COM_OAIPMH&VERB=LISTRECORDS&METADATAPREFIX=OAI_DC

THANK YOU Neal Harmeyer – Digital Archivist – Amy Hatfield – Metadata Specialist – Brandon Beatty – PURR Software Developer –