DP Knowhow: Open Archival Information Systems (OAIS) in ISO APA/C-DAC International Conference on Digital Preservation and the Development of Trusted.

Slides:



Advertisements
Similar presentations
Preservation by Migration to XML Dirk Roorda. work on a preservation strategy positioning of the XML preservation strategy implementing the strategy in.
Advertisements

CASPAR Validation. Metrics CASPAR Approach Representation Information (RepInfo) RepInfo Networks and their maintenance.
Long-Term Preservation. Technical Approaches to Long-Term Preservation the challenge is to interpret formats a similar development: sound carriers From.
DigCCurr 2007: What digital curators do and what they need to know The CASPAR view on: What digital curators do and what they need to know : Research Perspectives.
Midterm Workshop, Catania, April 2014 D3.1 State of the art assessment on Linked Data and Digital Preservation René van Horik, Data Archiving & Networked.
Co-funded by the European Union under FP7-ICT Alliance Permanent Access to the Records of Science in Europe Network Co-ordinated by aparsen.eu #APARSEN.
Co-funded by the European Union under FP7-ICT Alliance Permanent Access to the Records of Science in Europe Network Co-ordinated by aparsen.eu #APARSEN.
Project Overview APA Conference 2012 ESA/ESRIN (Frascati), 6-7 November 2012 D. Giaretta (APA)
HATHI TRUST A Shared Digital Repository Digital Repositories for Preservation and Access Digital Directions 2013 Jeremy York July 22, 2013 Unless otherwise.
CODATA 2006, Beijing, China Oct CASPAR: Early results and future goals David Giaretta.
SCIDIP-ES services and toolkits David Giaretta. Preserving digitally encoded information Ensure that digitally encoded information are understandable.
SCIDIP-ES Components Oct ,Brussels. Basic Preservation Strategies Often stated as: “Emulate or Migrate” OAIS concepts change these to: Add Representation.
Remaining Future Proof Publishers and Digital Preservation Eefke Smit STM Director Standards and Technology Berlin, APE 2014 Conference, January 29, 2014.
Project Overview APA Conference 2012 ESA/ESRIN (Frascati), 6-7 November 2012 M. Albani (European Space Agency), Project Coordinator.
Current Thinking on Digital Preservation: Role of Metadata Oya Y. Rieger Coordinator, Library Office of Distributed Learning Cornell University Library.
AIP Archival Information Package – Defines how digital objects and its associated metadata are packaged using XML based files. METS (binding file) MODS.
E-IRG Open Workshop on e-Infrastructures 4-5 Oct 2006 CASPAR Project Digital Preservation and Digital interoperability.
ADASS Sept Trusted Data Repositories David Giaretta STFC and Director of CASPAR and Associate Director UK Digital Curation Centre.
Co-funded by the European Union under FP7-ICT Alliance Permanent Access to the Records of Science in Europe Network Co-ordinated by aparsen.eu #APARSEN.
Who is doing a good job in digital preservation? Audit and Certification of Digital Repositories: ISO and the European Framework.
Different approaches to digital preservation Hilde van Wijngaarden Digital Preservation Officer Koninklijke Bibliotheek/ National Library of the Netherlands.
Preserving Digital Collections Andrea Goethals Florida Center for Library Automation (FCLA)
An Overview of Selected ISO Standards Applicable to Digital Archives Science Archives in the 21st Century 25 April 2007 Donald Sawyer - NASA/GSFC/NSSDC.
David Giaretta Associate Director (Development) Funders: DCC Development Digital Curation Centre a centre of expertise in data curation and preservation.
Ingest and Dissemination with DAITSS Presented by Randy Fischer, Programmer, Florida Center for Library Automation, University of Florida DigCCurr2007.
Science Archives in the 21st Century 25/26 April Towards an International standard for Audit and Certification of Digital Repositories David Giaretta.
How to build your own Dark Archive (in your spare time) Priscilla Caplan FCLA.
APARSEN Metadata for preservation, curation and interoperability Workshop on Research Metadata in Context 7-8 Sept 2010, Nijmegen David Giaretta APA and.
DAITSS: Dark Archive in the Sunshine State Priscilla Caplan, Florida Center for Library Automation DCC Workshop on Long-term Curation within Digital Repositories.
CASPAR Framework and Lessons Learned David Giaretta.
The FCLA Digital Archive Joint Meeting of CSUL Committees, 2005.
Digital Preservation: Current Thinking Anne Gilliland-Swetland Department of Information Studies.
Small steps and lasting impact: making a start with preservation or It’s not all NASA Patricia Sleeman Digital Archives and Repositories University of.
Data in the NEES Data Repository Conditions for Current and Future Use and Re-Use Quake Summit 2012, Boston, Massachusetts July 12, 2012 Stanislav Pejša.
Integrating metadata schema registries with digital preservation systems to support interoperability Michael Day UKOLN, University of Bath, UK
DP Knowhow: Audit and Certification in ISO Standard APARSEN-EGI-Community-Forum Training on Data Preservation 22 nd of May 2014 Helsinki, Finland.
Metadata for digital preservation: a review of recent developments Michael Day UKOLN, University of Bath ECDL2001, 5th European Conference.
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
Archiving microdata Standards and good practices United Nations Statistics Commission New York, February 26, 2009 Olivier Dupriez World Bank, Development.
Lifecycle Metadata for Digital Objects November 15, 2004 Preservation Metadata.
The OAIS Reference Model and Trustworthy Repositories Josh Lubell Manufacturing Engineering Laboratory NIST
Institutional Repositories July 2007 DIGITAL CURATION creating, managing and preserving digital objects Dr D Peters DISA Digital Innovation South.
Cedars work on metadata Michael Day UKOLN, University of Bath Cedars Workshop Manchester, February 2002.
APA’s Virtual Centre of Excellence (VCOE) and its Vision APARSEN-EGI-Community-Forum Training on Data Preservation 22 nd of May 2014 Helsinki Matthias.
DP Knowhow: Introduction to Audit and Certification in ISO APARSEN-EGI Community Workshop on Managing, Computing and Preserving Big Data for Research.
School on Grid & Cloud Computing International Collaboration for Data Preservation and Long Term Analysis in High Energy Physics.
Barbara Sierman SCAPE Training Statsbiblioteket, Aarhus, November 2013 Preservation Policy in SCAPE.
Co-funded by the European Union under FP7-ICT Alliance Permanent Access to the Records of Science in Europe Network Co-ordinated by aparsen.eu #APARSEN.
PV 2009, ESAC, Spain, 1-3 Dec Long term data and knowledge preservation for the Earth Sciences Archive S. ALBANI (ESA) D. Giaretta (STFC) PV 2009.
Co-funded by the European Union under FP7-ICT Alliance Permanent Access to the Records of Science in Europe Network aparsen.eu #APARSEN Options.
Co-funded by the European Union under FP7-ICT Co-ordinated by aparsen.eu #APARSEN CoE offerings Simon Lambert STFC All Hands Meeting, Amsterdam,
Co-ordinated by aparsen.eu #APARSEN Co-funded by the European Union under FP7-ICT Services and Sustainability David Giaretta,
Joint Meeting of CSUL Committees,
Metadata Issues in Long-term Management of Data and Metadata
Preserving Digital Collections
Digital Sustainability on the EU Policy Level
Digital Sustainability on the EU Policy Level
The Role of Trustworthy Digital Repositories in Sustainability
WP14 Common Testing Environments
Ingest and Dissemination with DAITSS
Dependency Management
D33.1B PEER REVIEW OF DIGITAL REPOSITORIES
Building A Repository for Digital Objects
DAITSS: Dark Archive in the Sunshine State
Active Data Management in Space 20m DG
EPrints Preservation.
Experiences of the Digital Repository of Ireland
Robin Dale RLG OAIS Functionality Robin Dale RLG
Research data lifecycle²
How to Implement an Institutional Repository: Part II
Presentation transcript:

DP Knowhow: Open Archival Information Systems (OAIS) in ISO APA/C-DAC International Conference on Digital Preservation and the Development of Trusted Digital Repositories 5-64 February 2014 New Delhi, India David Giaretta APA This work is made available under the terms of the Creative Commons Attribution- ShareAlike 3.0 license,

Digital Preservation… Easy to do… …as long as you can provide money forever Easy to test claims about repositories… …as long as you live a long time

Problems when preserving data Preserve? Preserve what? For how long? How to test? Which people? Which organisations? How well? Metadata? – What kind? How much?

Difficulties in digital preservation Many different terminologies Many different views of preservation Many different kinds of digital objects – Documents – Data – …… and new types of objects Tools and Services – Which ones work for which digital objects? – Which tools/techniques fit together? – How to integrate new tools Consistent training needed Risks vs Cost Who can you trust? } Need a consistent, coherent approach to digital preservation - APARSEN. Need an Audit and Certification system – ISO OAIS – ISO 14721

Preservation techniques For each technique look for evidence – what evidence? must at least make sure we consider different types of data – rendered vs non-rendered – composite vs simple – dynamic vs static – active vs passive must look at all types of threats

Basic preservation activities Libraries say: “Emulate or migrate” – Works well with data only in special cases Can repeat what was done before instead of new things – Does not help with building cross-disciplinary communities Can repeat what has been done before BUT Cannot use new applications Convert to format which new software can use BUT What if there are many software systems?

Contains numbers – need meaning 7

...to be combined and processed to get this 8 Level 2Level 0Level 1 Processing Processing/c ombining

...or this 9

Additional technique: add Representation Information Descriptions of the digitally encoded object Ideal description allows a machine to extract information

OAIS Information model: Representation Information The Information Model is key Recursion ends at KNOWLEDGEBASE of the DESIGNATED COMMUNITY (this knowledge will change over time and region) Does not demand that ALL Representation Information be collected at once. A process which can be tested

FITS FILE FITS DICTIONARY FITS STANDARD PDF SOFTWARE JAVA VM PDF STANDARD FITS JAVA SOFTWARE DICTIONARY SPECIFICATION XML SPECIFICATION UNICODE SPECIFICATION Rep Info Network

Building on simple virtualisation of tabular data

AND – be prepared to Hand-over Preservation requires funding Funding for a dataset (or a repository) may stop Need to be ready to hand over everything needed for preservation – OAIS (ISO 14721) defines “Archival Information Package (AIP). – Issues: Storage naming conventions Representation Information Provenance ….

END