Implementing an Integrated Digital Asset Management System: FEDORA and OAIS in Context Paul Bevan DAMS Implementation Manager

Slides:



Advertisements
Similar presentations
Data Publishing Service Indiana University Stacy Kowalczyk April 9, 2010.
Advertisements

An Introduction to Repositories Thornton Staples Director of Community Strategy and Alliances Director of the Fedora Project.
Vital Implementation: BL-NLW-Tessella Ingest Meeting VITAL Implementation BL-NLW-Tessella Ingest Meeting 3 rd May 2007 Paul Bevan –
October 28, 2003Copyright MIT, 2003 METS repositories: DSpace MacKenzie Smith Associate Director for Technology MIT Libraries.
Vital Implementation Update Vital Implementation Update 11 th January 2006 Paul Bevan – Glen Robson –
The future’s so bright…. DAITSS DIGITAL PRESERVATION SYSTEM: RE-ARCHITECTED, RE- WRITTEN, AND OPEN SOURCE Priscilla Caplan Florida Center for Library Automation.
DRS 2 one in a series of periodic updates Harvard University Library Andrea Goethals October 21, 2009 DRS = Digital Repository Service.
Transformations at GPO: An Update on the Government Printing Office's Future Digital System George Barnum Coalition for Networked Information December.
Funded by: © AHDS Sherpa DP – a Technical Architecture for a Disaggregated Preservation Service Mark Hedges Arts and Humanities Data Service King’s College.
Fedora 3.0 and METS: A Partnership for the Organization, Presentation and Preservation of Digital Objects Open Repositories Georgia Tech, Atlanta,
Depositing e-material to The National Library of Sweden.
Common Use Cases for Preservation Metadata Deborah Woodyard-Robinson Digital Preservation Consultant Long-term Repositories:
All Things to All People Combining Resources to Build an Integrated Digital Repository Preservation and Access for Electronic College and University Records.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
WMS: Democratizing Data
Metadata: use of METS with Fedora Marie Lagerwall Technical Officer Centre for Learning Technology London School of Economics and.
Consists of the following components (which are purchased separately) Resource Discovery * Web based deposit (including authorisation)* Full Text Index.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation Mike Smorul, Joseph JaJa, Yang Wang, and Fritz McCall.
US GPO AIP Independence Test CS 496A – Senior Design Team members: Antonio Castillo, Johnny Ng, Aram Weintraub, Tin-Shuk Wong Faculty advisor: Dr. Russ.
Improving access to digital resources: a mandate for order mandate: managing digital assets in tertiary education craig green,
The British Library’s METS Experience The Cost of METS Carl Wilson
Metadata: Its Functions in Knowledge Representation for Digital Collections 1 Summary.
Digital Asset Management for All? Visualising a Flexible DAMS Solution for Small and Medium Scale Institutions Paul Bevan Llyfrgell Genedlaethol Cymru.
Architecting an Extensible Digital Repository Anoop Kumar, Ranjani Saigal,Rob Chavez, Nikolai Schwertner Tufts University, Medford, MA.
Digital Asset Management Strategies at NLW Digital Asset Management Strategies at the National Library of Wales 18 th September 2007 Paul Bevan
Ingest and Dissemination with DAITSS Presented by Randy Fischer, Programmer, Florida Center for Library Automation, University of Florida DigCCurr2007.
METS-Based Cataloging Toolkit for Digital Library Management System Dong, Li Tsinghua University Library
Statewide Digitization and the FCLA Digital Archive Priscilla Caplan, Florida Center for Library Automation Statewide Digitization Planners Meeting OCLC,
Adventures in Digital Asset Management: Fedora at the National Library of Wales Glen Robson National Library of Wales
Ymchwil Research Ymchwil Research RESAW Ioan Isaac-Richards Ingest Processes Manager Head of Web Archiving
1 The Universal Object Format - A METS Profile for an archiving and exchange format for digital objects.
Glen Robson Head of Systems Unit National Library of Wales
How to build your own Dark Archive (in your spare time) Priscilla Caplan FCLA.
1 XML as a preservation strategy Experiences with the DiVA document format Eva Müller, Uwe Klosa Electronic Publishing Centre Uppsala University Library,
A hybrid approach of digital long term preservation to institutional repositories - A case study of DSpace/SRB Integration Ya-ning Arthur Chen, Feng-chien.
Archivematica, NLW & ARCW Glen Robson Head of Systems
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
DAMS Implementation at NLW DAMS Implementation at NLW 20 th February 2007 Paul Bevan
Implementor’s Panel: BL’s eJournal Archiving solution using METS, MODS and PREMIS Markus Enders, British Library DC2008, Berlin.
The FCLA Digital Archive Joint Meeting of CSUL Committees, 2005.
Implementation of PREMIS in METS Rebecca Guenther Sr. Networking & Standards Specialist, Library of Congress PREMIS Implementation Fair San.
Implementing an Integrated DAMS FEDORA / VITAL at the National Library of Wales OR08 3 rd April 2008 Paul Bevan Glen Robson
CBSOR,Indian Statistical Institute 30th March 07, ISI,Kokata 1 Digital Repository support for Consortium Dr. Devika P. Madalli Documentation Research &
Digital preservation activities at the NLW Sally McInnes 18 September 2009.
Digital initiatives Digital Initiatives at the National Library of Wales 19 th April 2007 Paul Bevan
Persistent Digital Archives and Library System (PeDALS)
VITAL at the National Library of Wales Glen Robson
Selene Dalecky March 20, 2007 FDsys: GPO’s Digital Content System.
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
The New DRS Introduction. What is DRS? Digital repository for preservation and access – Maintains integrity of deposited content – Preserves content for.
Funded by: © AHDS Preservation in Institutional Repositories Preliminary conclusions of the SHERPA DP project Gareth Knight Digital Preservation Officer.
DAITSS: Dark Archive in the Sunshine State Priscilla Caplan Florida Center for Library Automation (FCLA)
The NLW Digital Asset Management System Paul Bevan DAMS Implementation Manager
Digital Preservation Panel Medusa at the University of Illinois at Urbana-Champaign: A Digital Preservation Service Based on PREMIS Kyle Rimkus, Preservation.
The library is open Digital Assets Management & Institutional Repository Russian-IUG November 2015 Tomsk, Russia Nabil Saadallah Manager Business.
Implementing PREMIS in DigiTool Michael Kaplan ALA 2007 Update.
DAITSS and the Florida Digital Archive Priscilla Caplan Florida Center for Library Automation iPRES 2006.
Fedora Metadata The Basics 9/9/2008. Mini Glossary Fedora: ‘ Flexible Extensible Digital Repository Object Architecture;’ asset repository, metadata architecture.
Institutional Repositories July 2007 DIGITAL CURATION creating, managing and preserving digital objects Dr D Peters DISA Digital Innovation South.
Considering the Impact of your Electronic Preservation Strategy on the Organisation: Experiences at the National Library of Wales Paul Bevan DAMS Implementation.
NLW. Object Classes Class 1  1 MARC Record  1 Image  No METS Class 2  1 MARC Record  Many images  No METS Class 3  1 MARC Record  Many.
The OAIS model SEEDS meeting May 5 th, 2015, Lausanne Bojana Tasic.
Joint Meeting of CSUL Committees,
Building A Repository for Digital Objects
DAITSS: Dark Archive in the Sunshine State
DAITSS and the Florida Digital Archive
Statewide Digitization and the FCLA Digital Archive
Fedora Metadata The Basics 9/9/2008.
Metadata to fit your needs... How much is too much?
Robin Dale RLG OAIS Functionality Robin Dale RLG
Presentation transcript:

Implementing an Integrated Digital Asset Management System: FEDORA and OAIS in Context Paul Bevan DAMS Implementation Manager

Structure Background and overview Background and overview OAIS Model OAIS Model Why OAIS? Why OAIS? Overview Overview Ingest Ingest Archival Storage Archival Storage Access Access (Administration, Data Management) (Administration, Data Management) METS METS Integration as a project (Issues and Tasks) Integration as a project (Issues and Tasks)

Institutional Context The LLGC DAMS is safekeeping for Wales’ digital assets but, it is an element within a wider Digital Asset Management Solution, which is an element within the library’s integrated systems, which come together to: The LLGC DAMS is safekeeping for Wales’ digital assets but, it is an element within a wider Digital Asset Management Solution, which is an element within the library’s integrated systems, which come together to: … preserve and give access to all kinds and forms of recorded knowledge, especially relating to Wales and the Welsh and other Celtic peoples, for the benefit of the public including those engaged in research and learning.

Institutional Context IMS Procurement high level deliverables: IMS Procurement high level deliverables: Improves efficiency and substantially simplifies the Library’s technical architecture and infrastructure. Improves efficiency and substantially simplifies the Library’s technical architecture and infrastructure. Interfaces seamlessly across different parts of the Library with links to, for example, remote document delivery systems. Interfaces seamlessly across different parts of the Library with links to, for example, remote document delivery systems. Conforms to and interfaces with international standards and related activities based on an open architecture. Conforms to and interfaces with international standards and related activities based on an open architecture. Is open and hospitable to external user systems, e.g. for document requesting, resource discovery and inter-library loans. Is open and hospitable to external user systems, e.g. for document requesting, resource discovery and inter-library loans. Is operational with successfully migrated legacy data and data from external sources. Is operational with successfully migrated legacy data and data from external sources. Accommodates the functions of the National Screen and Sound Archive of Wales. Accommodates the functions of the National Screen and Sound Archive of Wales. Is open and hospitable to the information community in Wales e.g. for data exchange, maintenance and storage, and for the ingest of electronic resources. Is open and hospitable to the information community in Wales e.g. for data exchange, maintenance and storage, and for the ingest of electronic resources.

Institutional Context: Development Aims History of development with Fedora History of development with Fedora Key Aims: Key Aims: Add functionality to VITAL Add functionality to VITAL Developments in line with communities (Fedora, Vital and other DAMS) Developments in line with communities (Fedora, Vital and other DAMS) Skills and Resources Skills and Resources Cataloguers experience Cataloguers experience Re-use skills Re-use skills Single Search Single Search Solution to adhere to Standards; METS, PREMIS, OAIS, TDR etc etc Solution to adhere to Standards; METS, PREMIS, OAIS, TDR etc etc

OAIS Overview

Why OAIS? Useful Overview Useful Overview Standard and ‘tested’ Standard and ‘tested’ Overlaps with TDR (medium-term goal) Overlaps with TDR (medium-term goal) Granularity GranularityBut... Not overly restrictive (interpretation?). Not overly restrictive (interpretation?). Complex & inaccessible Complex & inaccessible

Rights Management Object Storage Servers Dissemination Layer FEDORA Preservation Check (eg. DROID) Virus Check Error Check (Checksum) Preservation Tasks (eg. Migration) Object Electronic Deposit Off-Air Recording Digital Archives Digitisation Ingest Mechanisms …

FEDORA iPortal Storage Solution(s) VITAL Client User Staff Layered Disseminator Structure Direct Route (eg. Google, URL) External Depositor Ingest Process Web Deposit Interface VITAL Access Portal Rights?

Modelling: Ingest

Rules for being an AIP Every object will have a MARC record (at some level) within the IMS Every object will have a MARC record (at some level) within the IMS Every object in the repository will have a METS document Every object in the repository will have a METS document Every object will have DC for OAI-PMH Every object will have DC for OAI-PMH METS will be our SIP, AIP and DIP METS will be our SIP, AIP and DIP METS will be the policy, FEDORA services will enact the policy. METS will be the policy, FEDORA services will enact the policy. eg. DC Section in METS populates the DC datastream eg. DC Section in METS populates the DC datastream eg. Structural Map held in METS, structure in RELS-EXT datastream eg. Structural Map held in METS, structure in RELS-EXT datastream

METS Creation Existing METS Document (if applicable) MARC XML Default METS Document METS SIP JHove DC Mods PREMIS Technical – MIX Behaviour METS:Rights METS:StructuralMap etc.

Ingest Revisited Checksum, Error Checking etc Ingest Processes (IMS, MARCXML etc) Update IMS with 856 link to Handle

Modelling: Archival Storage

Object (PID/Handle) DS: METS DS: DC (OAI-PMH) DS: Relationships DS: Object (eg. TIFF File) DS: Object (eg. JPEG File) DS: Object (eg. Thumbnail File) DS: Object (eg. Zoomify File) Referenced Near-Line Tape Store Fast Image Server Server Object Model (AIP): Still Image

Metadata Types & Locations Asset Virtua VITAL MARC21 METS DC

Archival Storage Revisited FEDORA/VITALDevelopmentsExisting/Storage Processes

Modelling: Access

Access Revisited FEDORA/VITAL IMS/Virtua

Briefly: Administration?

Briefly: Data Management?

METS METS as SIP, AIP and DIP METS as SIP, AIP and DIP Contains Metadata from: Contains Metadata from: JHOVE/Automatically Extracted JHOVE/Automatically Extracted RightsMD RightsMD DescriptiveMD (minimum required for locating) DescriptiveMD (minimum required for locating) PreservationMD PreservationMD METS functions as the rules not the enforcement mechanism METS functions as the rules not the enforcement mechanism

Key Issues for Integration Seamless Transition IMS to DAMS Seamless Transition IMS to DAMS Skin Skin Language choice Language choice Persistent Session Persistent Session Search history Search history Cart Cart Shared Rights Shared Rights LDAP LDAP Single Sign on Single Sign on

IMS Linking (Developments) Updating of MARC Records in IMS Updating of MARC Records in IMS Ingest of descriptive metadata from IMS Ingest of descriptive metadata from IMS Single Search & Sign On Single Search & Sign On Transparent Dissemination Experience Transparent Dissemination Experience Rights Management Rights Management

Managing the Implementation Implementation Group comprising mix of standards, IMS project management, technical, and digitisation staff. Carried over from pilot. Implementation Group comprising mix of standards, IMS project management, technical, and digitisation staff. Carried over from pilot. 2 DAMS Implementation Managers (Systems & Technical) 2 DAMS Implementation Managers (Systems & Technical) Key interactions with other personnel as required. Key interactions with other personnel as required.

Managing the Implementation Milestones: Milestones: Migration of existing Digitised Material Migration of existing Digitised Material Switch over to VITAL for delivery of assets Switch over to VITAL for delivery of assets Ingest of other existing formats (eg. VDEP, Websites, A/V) Ingest of other existing formats (eg. VDEP, Websites, A/V) Implementation of further disseminators required for access. Implementation of further disseminators required for access.

Questions?