1 The Universal Object Format - A METS Profile for an archiving and exchange format for digital objects.

Slides:



Advertisements
Similar presentations
1 Data for the Future: the German Project "Co-operative Development of a Long-term Digital Information Archive" (kopal) Hands-on Workshops Reinhard Altenhöner,
Advertisements

Preservation Features in Repository Software PRESERV: Tim Brody University of Southampton.
1 Metadata Tools for JISC Digitisation Projects of still images and text Ed Fay BOPCRIS, Hartley Library University of Southampton.
METS Awareness Training An Introduction to METS Digital libraries – where are we now? Digitisation technology now well established and well-understood.
October 28, 2003Copyright MIT, 2003 METS repositories: DSpace MacKenzie Smith Associate Director for Technology MIT Libraries.
Standards showcase: MODS, METS, MARCXML ALA Annual 2006 Rebecca Guenther and Jackie Radebaugh Network Development and MARC Standards Office Library of.
METS: An Introduction Towards a Digital Object Standard Rick Beaubien Library Systems Office U.C. Berkeley.
Kopal - a Co-operative Approach to develop a Long-Term Digital Information Archive ICOLC 2006, Rome Dr. Thomas Wollschläger, German National Library (GNL)
Chinese-European Workshop on Digital Preservation, Beijing July 14 – Network of Expertise in Digital Preservation 1 National and International.
Interoperability and Preservation with the Hub and Spoke (HandS) Matt Cordial, Tom Habing, Bill Ingram, Robert Manaster University of Illinois Urbana-Champaign.
Interoperability and Preservation with the Hub and Spoke (HandS) Tom Habing, Bill Ingram, Robert Manaster University of Illinois Urbana-Champaign
METS In order to reconstruct the archive, we will need to understand the METS files. METS is schema that provides a flexible mechanism for encoding descriptive,
METS Dr. Heike Neuroth EMANI – Project Meeting February 14 th - 16 th, 2002 Springer-Verlag Heidelberg Göttingen State and University Library (SUB)
| IFLA2010. Newspaper section | Changing preservations tasks for the German National Library: Some insights and preliminary remarks IFLA International.
Fedora 3.0 and METS: A Partnership for the Organization, Presentation and Preservation of Digital Objects Open Repositories Georgia Tech, Atlanta,
ISO & OAI-PMH By Neal Harmeyer, Amy Hatfield, and Brandon Beatty PURDUE UNIVERSITY RESEARCH REPOSITORY.
ETD‘s as pilot materials for long-term preservation efforts in kopal 9th ETD Conference 2006, Quebec Dr. Thomas Wollschläger, German National Library (GNL)
Joachim Bauer Senior System Engineer, CCS
US GPO AIP Independence Test CS 496A – Senior Design Team members: Antonio Castillo, Johnny Ng, Aram Weintraub, Tin-Shuk Wong Faculty advisor: Dr. Russ.
Merrilee Proffitt e(X)literature / Digital Cultures Project April 2003 News from the Digital Library The Metadata Encoding and Transmission Standard; the.
METS What is METS ? What is METS ? A schema that provides a flexible mechanism for encoding descriptive, administrative, and structural metadata for a.
Keeping the pieces together: The Role of METS in the Preservation of Digital Content Robin Wendler Harvard University Library January 16, 2005 [Men in.
METS Metadata Encoding and Transmission Standard Metadata Working Group Forum April 19, 2002.
DigiTool METS Profile DigiTool Version 3.0. DigiTool METS Profile 2 What is METS? A Digital Library Federation initiative built upon the work of MOA2.
US GPO AIP Independence Test CS 496A – Senior Design Fall 2010 Team members: Antonio Castillo, Johnny Ng, Aram Weintraub, Tin-Shuk Wong.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
AIP Archival Information Package – Defines how digital objects and its associated metadata are packaged using XML based files. METS (binding file) MODS.
US GPO AIP Independence Test CS 496A – Senior Design Team members: Antonio Castillo, Johnny Ng, Aram Weintraub, Tin-Shuk Wong Faculty advisor: Dr. Russ.
Incompatible or Interoperable? A METS bridge for a small gap between two digital preservation software packages Lucas Mak Metadata & CatalogLibrarian
OCLC Online Computer Library Center OCLC’s Digital Archive – Disseminating with METS Jay Goodkin Software Engineer Digital Collection and Preservation.
METS Intro & Overview Mets Opening Day Germany May 7, 2007 Nancy J. Hoebelheinrich Stanford University Libraries.
METS-Based Cataloging Toolkit for Digital Library Management System Dong, Li Tsinghua University Library
US GPO AIP Independence Test CS 496A – Senior Design Team members: Antonio Castillo, Johnny Ng, Aram Weintraub, Tin-Shuk Wong Faculty advisor: Dr. Russ.
Glen Robson Head of Systems Unit National Library of Wales
Implementing an Integrated Digital Asset Management System: FEDORA and OAIS in Context Paul Bevan DAMS Implementation Manager
How to build your own Dark Archive (in your spare time) Priscilla Caplan FCLA.
1 XML as a preservation strategy Experiences with the DiVA document format Eva Müller, Uwe Klosa Electronic Publishing Centre Uppsala University Library,
The Metadata Object Description Schema (MODS) NISO Metadata Workshop May 20, 2004 Rebecca Guenther Network Development and MARC Standards Office Library.
METS Profiles Brian Tingle co-chair, METS Editorial Board Technical Lead, Digital Special Collections California Digital Library University of California.
The DigiTool to FDA Program Lydia Motyka Florida Center for Library Automation.
An Introduction to METS Morgan Cundiff Network Development and MARC Standards Office Library of Congress Metadata Encoding and Transmission Standard.
Preservation Audio Using METS: The Sound Directions Project Robin Wendler Harvard University Library 7 May 2007.
HUB AND SPOKE TOOL SUITE PREMIS Implementation Fair – 7 October 2009 Bill Ingram Visiting Research Programmer University of Illinois at Urbana-Champaign.
Implementor’s Panel: BL’s eJournal Archiving solution using METS, MODS and PREMIS Markus Enders, British Library DC2008, Berlin.
Implementation of PREMIS in METS Rebecca Guenther Sr. Networking & Standards Specialist, Library of Congress PREMIS Implementation Fair San.
Habing1 Integrating PREMIS and METS PREMIS Tutorial Implementers’ Panel June 21, 2007, 9:00-5:30 Library of Congress, Jefferson Building, Whittall.
| Ingest Levels and Persistent Identification | October Ingest Levels and Persistent Identification Services for R & D and heritage organisations.
ETD2006 Preserving ETDs With D.A.I.T.S.S. FLORIDA CENTER FOR LIBRARY AUTOMATION FC LA PAPER AUTHORS: Chuck Thomas Priscilla.
IMPLEMENTATION ISSUES. How PREMIS can be used  For systems in development as a basis for metadata definition  For existing repositories as a checklist.
Integrating metadata schema registries with digital preservation systems to support interoperability Michael Day UKOLN, University of Bath, UK
VITAL at the National Library of Wales Glen Robson
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
Funded by: © AHDS Preservation in Institutional Repositories Preliminary conclusions of the SHERPA DP project Gareth Knight Digital Preservation Officer.
Interoperability and Collection of Preservation Metadata for Digital Repository Content Matt Cordial, Tom Habing, Bill Ingram, Robert Manaster University.
PREMIS at the British Library Markus Enders, The British Library PREMIS Implementation Fair, San Fransisco, CA 07 October 2009.
Metadata “Data about data” Describes various aspects of a digital file or group of files Identifies the parts of a digital object and documents their content,
The NLW Digital Asset Management System Paul Bevan DAMS Implementation Manager
The Care and Feeding of Digital Collections Amy Jackson March 14, 2005.
DAITSS and the Florida Digital Archive Priscilla Caplan Florida Center for Library Automation iPRES 2006.
MathArc Co-operating Preservation Archives Sharing Collections Among Dissimilar OAIS Repositories William Kehoe, Adam Smith, Marcy Rosenkrantz Cornell.
NLW. Object Classes Class 1  1 MARC Record  1 Image  No METS Class 2  1 MARC Record  Many images  No METS Class 3  1 MARC Record  Many.
Data Management and Archival Storage Bojana Tasić FORS SEEDS Workshop I Belgrade, October.
and Transmission Standard overview – and case study
FLORIDA CENTER FOR LIBRARY AUTOMATION
Building A Repository for Digital Objects
DAITSS and the Florida Digital Archive
An Introduction to Tessella and The Safety Deposit Box Platform
METS, MODS and PREMIS, Oh My! (and a little MIX and other schema too)
METS, MODS and PREMIS, Oh My! (and a little MIX and other schema too)
Digital Preservation through EPrints-Archivematica Integration
Presentation transcript:

1 The Universal Object Format - A METS Profile for an archiving and exchange format for digital objects

2 Overview  Project kopal  Long-term preservation Metadata for Electronic Resources (LMER)  Universal Object Format: Structure  Universal Object Format: METS Profile

3 Project kopal  German project: Co-operative Development of a Long-Term Digital Information Archive (2004 – 2007)  Core: OAIS-compliant DIAS by IBM (Content Manager, DB2, Tivoli Storage Manager, Websphere, Java components)  Tools to generate technical metadata (using JHOVE), create ingest packages and migrate objects: Open source koLibRI (kopal Library for Retrieval and Ingest) by Deutsche Nationalbibliothek and SUB Göttingen  Multi-user support  Generic SIP & DIP: Universal Object Format (UOF)  Long-term accessibility based on format migration

4 System overview GWDG (Göttingen) DIAS by IBM Account 1 Account 2 SUB Göttingen Deutsche Nationalbibliothek (Frankfurt) Locale Software

5 LMER  Long-term preservation metadata for electronic resources  Developed in 2003, current version: 1.2  Based on data model for preservation metadata by National Library of New Zealand  XML Schemas for  Object: Logical archiving and exchange unit, consists of one or more files  File: Metadata about every file incl. generic “black box” for format specific metadata (e. g., JHOVE output)  Process: History of file and object changes (e. g., migrations)  Modification: History of metadata changes

6 Universal Object Format: Structure  Generic description of packages for archiving and exchanging of digital objects  Based on METS and LMER  No limitations on file formats and file numbers  One packed file (e. g., ZIP or tar) per logical object, containing one METS file with descriptive metadata (e. g., Dublin Core) and technical metadata for long-term preservation (LMER)  In kopal:  Used as SIP and DIP (OAIS)  Metadata (Dublin Core and LMER) is stored in Data Management of DIAS  mets.xml stored as content, can be requested separately

7 Generic structure

8 Universal Object Format: METS Profile (1)  METS 1.4, LMER 1.2 (Object, File, Process)  No restrictions on integration of other XML metadata  Only inline XML metadata, no inline content files  No specs for Behaviour Section and Structural Map Linking  LMER in METS: No use of LMER elements if there are similar METS elements (especially in the file section)  One LMER object section (in amdSec/techMD) per mets.xml  A LMER file section (in amdSec/techMD) per file in File Section

9 Universal Object Format: METS Profile (2)  METS Header  OBJID: internal ID in DIP internal ID = object instance (original or migration) external ID = persistent identifier (same for original and migration)  CREATEDATE = creation/update of mets.xml , ROLE, TYPE, : Creating institution for a SIP, archiving institution for a DIP

10 Universal Object Format: METS Profile (3)  Descriptive Metadata  Optional  More than one allowed  Every inline XML, e. g., DC, MODS, MABxml  ID of dmdSec must be referenced in structural map of the type “ASSET”  In kopal (DIAS): Up to five sections, DC is stored in Data Management

11 Universal Object Format: METS Profile (4)  Administrative Metadata  At least one techMD for the whole archive object and one techMD for each file belonging to the object  LMER-Object: persistentIdentifier, groupIdentifier, objectVersion, startFile, numberOfFiles  LMER-File: format (REGISTRYNAME), linkedTo, xmlData (further technical metadata in an arbitrary XML schema, e. g., in kopal the output of JHOVE)  digiprovMD for object or for certain files  LMER-Process: oldMetadataRecordCreator, oldObjectIdentifier  All ID’s of techMD’s and digiprovMD’s must be referenced in File Section

12 Universal Object Format: METS Profile (5)  File Section  Only one  No embedded files, only relative links  For every one, LOCTYPE=“URL”, starting with “file://./”  Mandatory: ID, MIMETYPE, CREATED, SIZE, CHECKSUM, CHECKSUMTYPE  ADMID of : ID of techMD with LMER-Object and/or LMER- Process  ADMID of : ID of techMD with LMER-File and/or LMER- Process

13 Universal Object Format: METS Profile (6)  Structural Map  More than one allowed  One Structural Map with TYPE=“ASSET” is defined as one with a list of for each file, FILEID = ID in File Section, DMDID of = ID’s of all dmdSec’s  : external ID’s of other archive objects linked technically to the object (e. g., an XML schema)

14 Thank you! Visit  Download of koLibRI (beta)  Specifications of the Universal Object Format