Preservation Strategies: What do long-term archives do with my data? Jeff Arnfield NOAA’s National Climatic Data Center Version 1.0 Review Date.

Slides:



Advertisements
Similar presentations
Animesh Bhattacharyya Librarian, Vivekananda Mahavidyalaya
Advertisements

TIPR: Repository Exchange Package Use Cases and Best Practices Joseph Pawletko and Priscilla Caplan IS&T Archiving 2011.
An Introduction June 17, 2013 Open Archival Information System (OAIS)
ISO & OAI-PMH By Neal Harmeyer, Amy Hatfield, and Brandon Beatty PURDUE UNIVERSITY RESEARCH REPOSITORY.
Common Use Cases for Preservation Metadata Deborah Woodyard-Robinson Digital Preservation Consultant Long-term Repositories:
Developing a Records & Information Retention & Disposition Program:
Chronopolis: Preserving Our Digital Heritage David Minor UC San Diego San Diego Supercomputer Center.
Depositing and Disseminating Digital Resources Alan Morrison Collections Manager AHDS Subject Centre for Literature, Linguistics and Languages.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation Mike Smorul, Joseph JaJa, Yang Wang, and Fritz McCall.
Long-term Archive Service Requirements draft-ietf-ltans-reqs-00.txt.
Data Preservation Best Practices for preserving your research data for future reuse The goal of data preservation is to ensure that your data is in a sustainable.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
Data-PASS Shared Catalog Micah Altman & Jonathan Crabtree 1 Micah Altman Harvard University Archival Director, Henry A. Murray Research Archive Associate.
Architecture of information systems Document managment system Peter Záhorák.
Ingest and Dissemination with DAITSS Presented by Randy Fischer, Programmer, Florida Center for Library Automation, University of Florida DigCCurr2007.
Statewide Digitization and the FCLA Digital Archive Priscilla Caplan, Florida Center for Library Automation Statewide Digitization Planners Meeting OCLC,
Providing Access to Your Data: Access Mechanisms Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International.
Science Archives in the 21st Century 25/26 April Towards an International standard for Audit and Certification of Digital Repositories David Giaretta.
Recordkeeping for Good Governance Toolkit Digital Recordkeeping Guidance Funafuti, Tuvalu – June 2013.
Module 7. Data Backups  Definitions: Protection vs. Backups vs. Archiving  Why plan for and execute data backups?  Considerations  Issues/Concerns.
Elements of a Data Management Plan Ruth Duerr National Snow and Ice Data Center Version 1.0 Review Date Section: Data Management Plans.
Elements of a Data Management Plan: Identifying the materials to be created Ruth Duerr National Snow and Ice Data Center Version Review Date Section:
Providing Access to Your Data: Access Mechanisms Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International.
Washington State Archives Documenting Democracy Washington State Archives Digital Archives MOVING E-RECORDS INTO THE FUTURE Debbie Bahn and Scott Sackett.
1 Chapter Overview Publishing Resources in Active Directory Service Redirecting Folders Using Group Policies Deploying Applications Using Group Policies.
Data Management Practices for Early Career Scientists: Closing Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN.
DAITSS: Dark Archive in the Sunshine State Priscilla Caplan, Florida Center for Library Automation DCC Workshop on Long-term Curation within Digital Repositories.
Archival Information Packages for NASA HDF-EOS Data R. Duerr, Kent Yang, Azhar Sikander.
Libraries, Archives, and Digital Preservation: The Reality of What We Must Do Leslie Johnston Acting Director, National Digital Information Infrastructure.
Preservation Strategies: Intro to the OAIS Reference Model Curt Tilmes NASA Version 1.0 Review Date.
Creating documentation and metadata: Recording provenance and context Jeff Arnfield National Climatic Data Center Version a1.0 Review Date.
Elements of a Data Management Plan: Roles and Responsibilities Ruth Duerr National Snow and Ice Data Center Version 1.0 Review Date.
Preservation Strategies: Emerging standards for preservation Ronald Weaver National Snow and Ice Data Center Version 1.0 Review Date.
Preservation Strategies: Framing The Approach Nancy Hoebelheinrich Knowledge Motifs LLC Data Management Workshop American Geophysical.
Use & Access 26 March Use “Proof of Concept” Model for General Libraries & IS faculty Model for General Libraries & IS faculty Test bed for DSpace.
The FCLA Digital Archive Joint Meeting of CSUL Committees, 2005.
Linked Digital Archive Institutional Repository Rathachai Chawuthai CSIM/SET/AIT.
Archival Workshop on Ingest, Identification, and Certification Standards Certification (Best Practices) Checklist Does the archive have a written plan.
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
How to Implement an Institutional Repository: Part II A NASIG 2006 Pre-Conference May 4, 2006 Technical Issues.
Funded by: © AHDS Preservation in Institutional Repositories Preliminary conclusions of the SHERPA DP project Gareth Knight Digital Preservation Officer.
Data Integrity Issues: How to Proceed? Engineering Node Elizabeth Rye August 3, 2006
Digital Preservation across the technologies, strategies, open standards & interoperability aspects including the legal issues Pratik Shrivastava Scientist.
ISO/IEC 27001:2013 Annex A.8 Asset management
Washington State Archives Documenting Democracy Washington State Archives Digital Archives MOVING E-RECORDS INTO THE FUTURE Presented by Leslie Koziara.
M-1 INGEST OVERVIEW Don Sawyer National Space Science Data Center NASA/GSFC October 13, 1999.
Data Management Plans: Elements of a Data Management Plan Ruth Duerr National Snow and Ice Data Center Version 1.0 Review Date.
Ed Kearns National Climatic Data Center Asheville, NC.
Lifecycle Metadata for Digital Objects November 15, 2004 Preservation Metadata.
SEDAC Long-Term Archive Development Robert R. Downs Socioeconomic Data and Applications Center Center for International Earth Science Information Network.
Infrastructure Breakout What capacities should we build now to manage data and migrate it over the future generations of technologies, standards, formats,
The OAIS model SEEDS meeting May 5 th, 2015, Lausanne Bojana Tasic.
Digital Stewardship Lee Dotson Digital Initiatives Librarian University of Central Florida John C. Hitt Library Presentation available at
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Data Management and Digital Preservation Carly Dearborn, MSIS Digital Preservation & Electronic Records Archivist
R2R ↔ NODC Steve Rutz NODC Observing Systems Team Leader May 12, 2011 Presented by L. Pikula, IODE OceanTeacher Course Data Management for Information.
A Solution for Maintaining File Integrity within an Online Data Archive Dan Scholes PDS Geosciences Node Washington University 1.
Joint Meeting of CSUL Committees,
Slide Template for Module 4 Data Storage, Backup, and Security
Ingest and Dissemination with DAITSS
Statewide Digitization and the FCLA Digital Archive
Storage Basic recommendations:
Implementing an Institutional Repository: Part II
Research data preservation in Canada
Open Archival Information System
Robin Dale RLG OAIS Functionality Robin Dale RLG
Implementing an Institutional Repository: Part II
How to Implement an Institutional Repository: Part II
Presentation transcript:

Preservation Strategies: What do long-term archives do with my data? Jeff Arnfield NOAA’s National Climatic Data Center Version 1.0 Review Date

Preservation Strategies: What do long-term archives do with my data?; Version 1.0, Reviewed xx/xx/xxxx Overview A long term archive’s primary goal is “to protect and serve” by ensuring that its data holdings, include the metadata necessary for discovery and interpretation, remain intact, available and usable. Ensuring the long term integrity and viability of data is an active, ongoing process. A long term archive manages the details for you.

Preservation Strategies: What do long-term archives do with my data?; Version 1.0, Reviewed xx/xx/xxxx Define roles and responsibilities Data archives work with data submitters to concisely define their respective expectations and responsibilities for the body of data to be archived. Such an accord is often documented in a submission agreement. The archive’s requirements for data format, content and packaging are clearly enumerated. The archive will also require the metadata necessary to characterize, read, advertise and properly interpret your data. Limitations on the data’s distribution and use are explicitly spelled out in these submission agreements. Plans for versioning, if updates are envisioned, will usually also be addressed during the planning process.

Preservation Strategies: What do long-term archives do with my data?; Version 1.0, Reviewed xx/xx/xxxx Ingest, identify and store Your data must be archived using a non-proprietary format to ensure that it may be read in the future. The archive will work with you to ensure your data uses such a format. The archive may ensure that your data are received intact using checksums or other techniques. The data archive will assign a unique identifier to your data, providing a stable way to reference it. In addition to the metadata you provide, the archive may generate data management metadata for your submission. Your data will be securely stored to ensure accessibility and its long term integrity.

Preservation Strategies: What do long-term archives do with my data?; Version 1.0, Reviewed xx/xx/xxxx Preserve data integrity Your content must be protected against corruption and modification. File checksums and other techniques help ensure that data files remain intact and unaltered. Storage devices and media can fail due to equipment problems, and an entire location may be compromised by natural disaster. A data archives usually maintains backup copies of data at an offsite location to ensure its holdings survive such events. Archives plan for and manage migration of data to new media, storage architectures and formats to avoid obsolescence and help prevent media failure.

Preservation Strategies: What do long-term archives do with my data?; Version 1.0, Reviewed xx/xx/xxxx Advertise and provide access Archives use metadata to permit your data to be discovered, acquired and interpreted. In addition to employing in-house discovery and access tools, archives often publish metadata to various clearinghouses, portals and registries. Such resources can make your data available to a much broader community. Archives support access requests to your data by packaging and delivering it, along with associated metadata. A data archive will control access to its holdings, enforcing any distribution restrictions or limitations specified in the submission agreement.

Preservation Strategies: What do long-term archives do with my data?; Version 1.0, Reviewed xx/xx/xxxx References and Resources Van den Eynden, V., Corti, L., Woollard, M., Bishop, L., & Horton, L. (2011.). Managing and sharing data : best practices for researchers. Colchester: University of Essex. UK Data Archive. archive.ac.uk/media/2894/managingsharing.pdfwww.data- archive.ac.uk/media/2894/managingsharing.pdf Reference Model for an Open Archival Information System (OAIS)

Preservation Strategies: What do long-term archives do with my data?; Version 1.0, Reviewed xx/xx/xxxx Other Relevant Modules Planning for longer term perservation Work with your archive early and often Options for archiving your data Data transfer and submission agreements Intro to the OAIS Reference Model Responsible Use: Data restrictions