HydraDAM2 NEH funding January 2015 – December 2017 Builds on existing WGBH HydraDAM Open source Hydra ‘head’ Preservation-oriented digital asset management.

Slides:

Advertisements

Similar presentations

Digital Music and Audio Projects at Indiana University Jon Dunn Digital Library Program Indiana University August 16, 2001.

Advertisements

Data Publishing Service Indiana University Stacy Kowalczyk April 9, 2010.

XenData Digital Archives Video Performance. Built on IT Standards. XenData X1500 LTO-5 Workstation Archive June 2012 © Copyright 2012 XenData Limited.

DuraSpace: Digital Information All Ways, Always Pretoria, South Africa May 14 th, 2009.

Digital Collections: Storage and Access Jon Dunn Assistant Director for Technology IU Digital Library Program

OCLC Digital Archive Overview Judith Cobb LIPA Meeting July 2006.

Digital Preservation in Hydra/Fedora

Archiving research data in the cloud or in a local repository Michele Kimpton, CEO DuraSpace CNI Dec 2014.

Institutional Repositories It’s not Just the Technology New England Archivists Boston College March 11, 2006 Eliot Wilczek University Records Manager Tufts.

ArchiveSphere Penn State Repository By Carolyn Cole.

The KnowledgeBank: Powered by DSpace Laura Tull Systems Librarian Ohio State University Libraries WiLSWorld July 27, 2004.

Internet Resources Discovery (IRD) IBM DB2 Digital Library Thanks to Zvika Michnik and Avital Greenberg.

What is it? Hierarchical storage software developed in collaboration with five US department of Energy Labs since 1992 Allows storage management of 100s.

Designing Storage Architectures for Preservation Collections Library of Congress, September 17-18, 2007 Preservation and Access Repository Storage Architecture.

© 2009 EMC Corporation. All rights reserved. Content Addressed Storage Module 2.5.

Digital Object: A Virtual Online Storage Solution 598C Course Project Huajing Li.

US Hydra use overview Hydra Europe Symposium, Trinity College, Dublin, 7 th April 2014 Chris Awre Head of Information Management Library and Learning Innovation.

Greg Harris President & CEO We Can Work It Out Establishing the World’s First Rock and Roll Library.

Making the SHiFt: Using Sufia with Hydra/Fedora for collection management and access James Halliday Programmer/Analyst, Library Technologies Juliet L.

Hydra and the future A roadmap of sorts… Hydra Europe Symposium – London – 24 April 2015 Richard Green.

Building a Fedora Architecture to Support Diverse Collections Jon Dunn Ryan Scherle Digital Library Program Indiana University.

Columbia Digital Preservation Planning & Implementation Status Report, August 2010.

Jenn Riley Metadata Librarian Indiana University Digital Library Program.

H YDRA T ECHNICAL D IRECTIONS : L INKED D ATA, F EDORA 4, ETC. Mark Bussey Chief Information Leafblower.

Johannes Spitzbart Phonogrammarchiv, Austrian Academy of Sciences Österreichische Tage der Digitalen Geisteswissenschaften save the data - workshop on.

Digital Preservation 101, or, How to Keep Bits for Centuries Julie C. Swierczek Digital Asset Manager and Digital Archivist Harvard Art Museums.

Challenges of Digital Media Preservation Karen Cariani, Director Media Library and Archives Dave MacCarn, Chief Technologist.

Chapter 9 Section 2 : Storage Networking Technologies and Virtualization.

Avalon Partners Meeting Bloomington, Indiana October 2-3, 2013.

Copyright 2015 XenData Limited XenData X2500-USB LTO-6 Archive System.

Current issues in digital preservation: A perspective from the Digital Library Federation Donald Waters Director, Digital Library Federation June 23, 1998.

OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.

Implementing a Data Publishing Service via DSpace Jon W. Dunn, Randall Floyd, Garett Montanez, Kurt Seiffert May 20, 2009.

Avalon: Update and What’s Next Jon Dunn Interim Assistant Dean for Library Technologies Indiana University Hydra Connect 2 Cleveland, Ohio October 1, 2014.

The Data Capacitor and Digital Libraries at IU Jon Dunn Associate Director for Technology IU Digital Library Program February 22, 2006.

Katherine Skinner, Executive Director, Educopia Institute ESOPI 2013 Chapel Hill, NC April 19, 2013.

Archival Workshop on Ingest, Identification, and Certification Standards Certification (Best Practices) Checklist Does the archive have a written plan.

Content Addressed Storage

February 27, 2007 University Information Technology Services Research Computing Craig A. Stewart Associate Vice President, Research Computing Chief Operating.

VITAL at the National Library of Wales Glen Robson

Preservation of Obsolete Media: The Need for Managed Digital Storage Bruce Whisler Director of Music Technology Clemson University.

Digital Preservation 8/7/2012 Karen Estlund Head, Digital Library Services

Sound Directions, 2007 IU, Harvard Best practices for audio preservation digitization and storage INDIANA UNIVERSITY MEDIA DIGITIZATION AND PRESERVATION.

Time-Based Media Use Cases in an Integrated Access Environment, or …

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-71 DIMMI Project a DI gital M ulti M edia I nfrastructure.

Fedora and the Preservation of University Electronic Records Project NHPRC Electronic Records Research Grant Kevin L. Glick Manuscripts and Archives, Yale.

CBRC Digital Repository: Storing and viewing 3D objects, for science! James Halliday Programmer/Analyst, Library Technologies Juliet L. Hardesty

Preserving Electronic Mailing Lists as Scholarly Resources: The H-Net Archives Lisa M. Schmidt

Storage Why is storage an issue? Space requirements Persistence Accessibility Needs depend on purpose of storage Capture/encoding Access/delivery Preservation.

Portico’s “d-collections” preservation service Stephanie Orphan Positive trends in sustainability? Emerging approaches to archiving commercial databases.

Fedora Metadata The Basics 9/9/2008. Mini Glossary Fedora: ‘ Flexible Extensible Digital Repository Object Architecture;’ asset repository, metadata architecture.

IUScholarWorks Repository Update Jim Halliday, Stacy Konkiel & Jennifer Laherty.

Mark Notess Head, User Experience and Digital Media Services Library Technologies IU Bloomington Libraries 29 July 2014 RESEARCH NOW: VIDEO AND AUDIO.

Building a Digital Archive through Collaboration: A Report from OCLC Meg Bellinger OCLC Digital & Preservation Resources.

Managing live digital content with DuraSpace services Bill Branan PASIG Spring 2015.

Digital Asset Management Systems and Digital Preservation EUAN COCHRANE – DIGITAL PRESERVATION MANAGER YALE UNIVERSITY LIBRARY.

Time-Based Media Use Cases in an Integrated Access Environment, or …

Viacom system. Viacom sites Link System 1 Media Management Media management Metadata Handling Etere workflow Data mover Metadata bridge Data mover.

Discover ScholarSphere A repository service collaboration between the University Libraries and ITS.

OAIS (archive) OAIS (archive) Producer Management Consumer.

Adapting Sufia for Use in TEEAL-AgriKnowledge Mary Ochs, Director, Mann Library Joy Paulson, TEEAL Project Director USAIN 2016 Conference Gainesville,

Current as of April/May 2013

APTrust and Georgetown University Library

Now every configuration is possible

? What is Institutional Repository for Rutgers University

Avalon's Role in the Digital Collections Ecosystem

#dlbb IU Libraries and the Center for Biological Research Collections

Jon Dunn, Indiana University Marcel LaFlamme, Rice University

Jon W. Dunn Assistant Dean for Library Technologies

The Lone Digital Archivist’s Lament Other digital responsibilities Technical constraints Three common strategies, all with challenges: Disk images.

Presentation transcript:

HydraDAM2 NEH funding January 2015 – December 2017 Builds on existing WGBH HydraDAM Open source Hydra ‘head’ Preservation-oriented digital asset management system for time-based media

HydraDAM2 Project Goals: 1.Extend HydraDAM to work on Fedora 4 2.Develop Fedora 4 content models for audio and video preservation objects 3.Support two storage models: Online/nearline storage via disk or HSM/tape Offline storage on LTO tapes 4.Integrate HydraDAM2 with Avalon and OpenVault for access 5.Document/disseminate to wider community

MDPI: IU Media Digitization and Preservation Initiative Goal: “To digitize, preserve and make universally available by IU’s Bicentennial—subject to copyright or other legal restrictions—all of the time-based media objects on all campuses of IU judged important by experts.“ 300,000+ items 6.6PB over 4 years >10TB per day peak INDIANA UNIVERSITY3

Digital Preservation Strategy for MDPI Bit Storage: IU Scholarly Data Archive (SDA) 20PB+ HSM system (IBM HPSS) Mirrored between IUB and IUPUI File and Metadata Management: HydraDAM2 Out-of-region storage ???

Preservation Services Needed Storage/retrieval Scheduled fixity checking Audit and reporting Media migration (handled by HSM) Format migration (future) …

Key Fedora 4 Features for HydraDAM2 Content modeling Relationships, metadata Linked data Relationships, RDF representation of PBCore/EBUCore Large file support Fixity, audit Federation/projection Allow Fedora to manage data in HSM Ingest to HSM out-of-band from Fedora

Fedora 4 Path for HydraDAM2 HydraDAM built on Sufia 5 Sufia = engine behind Penn State’s ScholarSphere Sufia currently on a path to full Fedora 4 support Sufia 6 / Hydra 9 uses Fedora 4 Sufia working on Portland Common Data Model (PCDM) support in May-June HydraDAM2-specific development HSM federation connector (specifically, HPSS) Asynchronous storage support