Digital Archiving & Preservation : How to compare and contrast

Slides:

Advertisements

Similar presentations

Preserv: Preservation architecture and interface A brief overview of ideas wrt to the project plan For Preserv partners meeting, BL, London, 18th November.

Advertisements

Panel 2 – Promoting Re-Use of Scientific Collections John Harrison SHAMAN Project University of Liverpool

Introduction to Planets Hans Hofman Nationaal Archief Netherlands Prague, 17 October 2008.

Digital Preservation A Matter of Trust. Context * As of March 5, 2011.

An Introduction to Repositories Thornton Staples Director of Community Strategy and Alliances Director of the Fedora Project.

Digital Collections: Storage and Access Jon Dunn Assistant Director for Technology IU Digital Library Program

The future’s so bright…. DAITSS DIGITAL PRESERVATION SYSTEM: RE-ARCHITECTED, RE- WRITTEN, AND OPEN SOURCE Priscilla Caplan Florida Center for Library Automation.

Robert Sharpe, Operations Director METS in heterogeneous digital repositories.

BUILDING DIGITAL WEB ARCHIVES FOR FUTURE SCHOLARS Jani Stenvall

Technical Framework Charl Roberts University of the Witwatersrand Source: Repositories Support Project (JISC)

INFSO-RI Enabling Grids for E-sciencE Grid & Data Preservation Boon Low System Development, EGEE Training National.

Andrea Fojtu Charles University in Prague, National Library of the CR.

11© 2011 Hitachi Data Systems. All rights reserved. HITACHI DATA DISCOVERY FOR MICROSOFT® SHAREPOINT ® SOLUTION SCALING YOUR SHAREPOINT ENVIRONMENT PRESENTER.

Preservica: Preservation as a Service

Common Use Cases for Preservation Metadata Deborah Woodyard-Robinson Digital Preservation Consultant Long-term Repositories:

Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.

© 2010 Microsoft Corporation. All rights reserved. Quality Assurance: Towards Tools for Characterizing and Comparing Digital Documents Natasa Milic-Frayling.

Tools and Services for the Long Term Preservation and Access of Digital Archives Joseph JaJa, Mike Smorul, and Sangchul Song Institute for Advanced Computer.

An Introduction to DuraCloud Carissa Smith, Partner Specialist Michele Kimpton, Project Director Bill Branan, Lead Software Developer Andrew Woods, Lead.

Data-PASS Shared Catalog Micah Altman & Jonathan Crabtree 1 Micah Altman Harvard University Archival Director, Henry A. Murray Research Archive Associate.

Digital Asset Management for All? Visualising a Flexible DAMS Solution for Small and Medium Scale Institutions Paul Bevan Llyfrgell Genedlaethol Cymru.

DuraCloud A service provided by Sandy Payette and Michele Kimpton.

Electronic Mail List Preservation Takes Off: The H-Net Archive Lisa M. Schmidt MATRIX: The Center.

Preserving Electronic Mailing Lists: The H-Net Archive H-Net Mapped to the OAIS Model Preservation AssessmentPreservation improvementsOverview How H-Net.

CERN – IT Department CH-1211 Genève 23 Switzerland t CERN Open Source Collaborative tools: Digital Library Software Tim Smith CERN/IT.

Recordkeeping for Good Governance Toolkit Digital Recordkeeping Guidance Funafuti, Tuvalu – June 2013.

The way Archiving should be!.  Many organisations have either no archiving policy or is severely fragmented.  Archiving is considered as just another.

Managing Research Data – The Organisational Challenge at Oxford James A J Wilson Friday 6 th December,

Mass digitisation? Astrid Verheusen Projectmanager Research & Development Division National library of the Netherlands LIBER-EBLIDA Workshop on Digitisation.

Access Across Time: How the NAA Preserves Digital Records Andrew Wilson Assistant Director, Preservation.

OCLC Online Computer Library Center Digital Preservation with OCLC Digitization Standards: Issues & Updates Taylor Surface, OCLC.

The Global Video Grid: DigitalWell Update & Plan For SRB Integration Myke Smith, Manager Streaming Media Technologies University of Washington / ResearchChannel.

SCIELO AS AN OPEN ARCHIVE: the development of SciELO / OpenArchives data provider interface Prof. Carlos H. Marcondes Federal Fluminense University/ Information.

Digital Preservation MetaArchive Cooperative.  9:00-9:45 - Session 1: Digital Preservation Overview  9:45-11:00 - Session 2: Policy & Planning Overview.

The Data Capacitor and Digital Libraries at IU Jon Dunn Associate Director for Technology IU Digital Library Program February 22, 2006.

Microsoft Research Faculty Summit Natasa Milic-Frayling & Vijay Rajagopalan Microsoft Corporation.

The KB e-Depot long-term preservation of scientific publications in practice Marcel Ras, National library of The Netherlands.

Storage of digital objects Adolf Knoll National Library of the Czech Republic

ETD2006 Preserving ETDs With D.A.I.T.S.S. FLORIDA CENTER FOR LIBRARY AUTOMATION FC LA PAPER AUTHORS: Chuck Thomas Priscilla.

VITAL at the National Library of Wales Glen Robson

Selene Dalecky March 20, 2007 FDsys: GPO’s Digital Content System.

How to Implement an Institutional Repository: Part II A NASIG 2006 Pre-Conference May 4, 2006 Technical Issues.

The New DRS Introduction. What is DRS? Digital repository for preservation and access – Maintains integrity of deposited content – Preserves content for.

Funded by: © AHDS Preservation in Institutional Repositories Preliminary conclusions of the SHERPA DP project Gareth Knight Digital Preservation Officer.

NSDL & Access Management David Millman Columbia University Jan ‘02.

The NLW Digital Asset Management System Paul Bevan DAMS Implementation Manager

Preserving Electronic Mailing Lists as Scholarly Resources: The H-Net Archives Lisa M. Schmidt

DAITSS and the Florida Digital Archive Priscilla Caplan Florida Center for Library Automation iPRES 2006.

ARIADNE is funded by the European Commission's Seventh Framework Programme Archiving and Repositories Holly Wright.

Data Preservation at Rutherford Lab David Corney 9 th July 2010 KEK.

Digital Asset Management Systems and Digital Preservation EUAN COCHRANE – DIGITAL PRESERVATION MANAGER YALE UNIVERSITY LIBRARY.

Usecases: 1.ISIS Neutron Source 2.DP for HEP Matthew Viljoen STFC, UK APARSEN-EGI workshop: preserving big data for research Amsterdam Science Park 4-6.

Co-funded by the European Union under FP7-ICT Co-ordinated by aparsen.eu #APARSEN CoE offerings Simon Lambert STFC All Hands Meeting, Amsterdam,

FLORIDA CENTER FOR LIBRARY AUTOMATION

GISELA & CHAIN Workshop Digital Cultural Heritage Network

DAITSS and the Florida Digital Archive

An Introduction to Tessella and The Safety Deposit Box Platform

Joseph JaJa, Mike Smorul, and Sangchul Song

Antonella Fresa Technical Coordinator

Research Data Archive - technology

Archiving and Delivery of Student Portfolios

Best Practices for IW Document Management with SharePoint 2007

Storage & Digital Asset Management CIO Council Update

Digital Project Lifecycle Curating Across the Curriculum

eCulture Science Gateway – reloaded

Implementing an Institutional Repository: Part II

GISELA & CHAIN Workshop Digital Cultural Heritage Network

Robin Dale RLG OAIS Functionality Robin Dale RLG

Implementing an Institutional Repository: Part II

How to Implement an Institutional Repository: Part II

Presentation transcript:

Digital Archiving & Preservation : How to compare and contrast Knowledge is power Don’t lose it Digital Archiving & Preservation : How to compare and contrast Jon Tilbury 28-jun-2013

Introduction Jon Tilbury Director of Archiving Solutions at Tessella 20 users of our “Safety Deposit Box” Technology Archives, Libraries, STFC (Rutherford Appleton) Your premises and cloud Research led Also scientific technology support Software, consultancy Pharmaceuticals, Government Science, Consumer Goods, Energy 33 year heritage

Systems in 11 Countries across 4 Continents Wellcome Trust Corporate Archives Finnish National Archives Estonian National Archives Latvian National Archives UK National Archives Rotterdam City Archive National Archives of Hungary Budapest City Archives Dutch National Archives Malaysian Archives UK Parliament Swiss Federal Archives Austrian Archives

Cloud version launched in the US, soon in EU Archives of Michigan

Examples STFC FamilySearch Multitenant solution, available for other departments Preserving Neutron Scattering data from ISIS Ask Jens Jensen / Juan Bicarregui FamilySearch Genealogy Information from around the world Digitising microfilm to JPEG2000 Digitised in Utah, preserved in Maryland Initial storage 7Pb Ingest rate : 20Tb per day, rising to 50Tb per day Standard workflows on medium application servers Very fat pipes (especially to work area) Multiple parallel tape writers Dedicated pipe across US to replace FedEx

How to compare archiving systems Digital Archiving has many meanings Email archiving Backup++ Second line storage Bit store Etc How do we compare the approaches and evaluate what we want?

Digital Archiving Maturity Model File format obsolescence : identify, assess, migrate, validate Advanced software for high throughput, workflows, APIs, integration Software to manage hierarchy, security, metadata, search, browse, download 6. Information Preservation Preservation Constant checking of fixity, self healing from alternate copy 5: Information Processes Information preservation Ingest Access Data Man. Move content to appropriate storage Multiple locations, cost / performance / durability criteria 4: Information Organisation Reliable storage with high reliability e.g. RAIDx, long life tape, etc 3: Storage Validation Administration OAIS ISO 14721 2: Storage Management Storage Bit level preservation 1: Safe Storage

Examples 6. Information Preservation 5: Information Processes 4: Information Organisation 3: Storage Validation S3 Storage 2: Storage Management 1: Safe Storage

Digital Preservation Implementation Tenancy myData = getData() Workflow Programmer Interface Web based GUI SDB Preservation Platform Preservation Action Preservation Tools Preservation Planning Ingest Access Admin Data Management Archival Storage LDAP server Database Mass storage

Summary Use the Maturity Model to understand : What you want What competing systems do Implement the system that is right for you Don’t start from scratch Use available components, commercial if necessary Make sure you have the flexibility to grow Share knowhow, tools, techniques