May 16, 2012EDMC Workshop in College Park MDDan Kowal Trusted Digital Repositories: A New Audit Standard A Follow-on to the OAIS Dan Kowal, Data Administrator,

Slides:



Advertisements
Similar presentations
Criteria for the trustworthiness of data centres Jens Klump Helmholtz Centre Potsdam German Research Centre for Geosciences (GFZ) DataCite Summer Meeting.
Advertisements

Engaging repository policy with preservation Steve Hitchcock and Neil Jefferies* Preserv 2 Project School of Electronics and Computer Science (ECS), Southampton.
DSA and the Certification Framework Ingrid Dillo Data Archiving and Networked Services DSA Conference, Florence 10 December 2012.
Platter Planning Tool For Trusted Electronic Repositories
Project Appraisal Module 5 Session 6.
A centre of expertise in data curation and preservation London :: ARK Group Workshop: Archiving the Web :: 28 Sept 2006 Funded by: This work is licensed.
EMS Checklist (ISO model)
Auditing Digital Repositories : An Update on Standards, Preservation, and Usage Center for Research Libraries January 21, 2012.
Digital Preservation and Trusted Digital Repositories Priscilla Caplan Florida Center for Library Automation ALA 2005 Chicago IL.
Co-funded by the European Union under FP7-ICT aparsen.eu #APARSEN Audit & Certification: an auditors perspective Barbara Sierman, KB National Library.
Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.
HATHI TRUST A Shared Digital Repository Digital Repositories for Preservation and Access Digital Directions 2013 Jeremy York July 22, 2013 Unless otherwise.
Check Me Out! - The RLG/NARA task force on certifying digital repositories Kevin Ashley Head of Digital Archives Department ULCC.
Transformations at GPO: An Update on the Government Printing Office's Future Digital System George Barnum Coalition for Networked Information December.
Digital Preservation Practices and Strategies at Colorado State University Libraries.
TRAC / TDR ICPSR Trustworthy Digital Repositories.
Niklas Köhn HS 'Digital Libraries' Digital Preservation – Reasons & Methods Summary of Delos Summer School 2005 Digital Preservation Reasons & Methods.
APSR Forum on Long-Term Repositories National Library of Australia, 31 August – 1 September, Trust and the Web: Can the audit criteria apply to.
Kevin L. Glick Electronic Records Archivist Manuscripts and Archives Yale University ECURE Arizona State University March 2, 2005 Fedora and the Preservation.
Who is doing a good job in digital preservation? Audit and Certification of Digital Repositories: ISO and the European Framework.
NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.
Chinese-European Workshop on Digital Preservation, Beijing July 14 – Network of Expertise in Digital Preservation 1 Trusted Digital Repositories,
Ingest and Dissemination with DAITSS Presented by Randy Fischer, Programmer, Florida Center for Library Automation, University of Florida DigCCurr2007.
Ensuring Enduring Access: A Forum on Digital Preservation, July 21, 2009.
Science Archives in the 21st Century 25/26 April Towards an International standard for Audit and Certification of Digital Repositories David Giaretta.
Repository Requirements and Assessment August 1, 2013 Data Curation Course.
Data Archiving and Networked Services DANS is an institute of KNAW en NWO Trusted Digital Archives and the Data Seal of Approval Peter Doorn Data Archiving.
Page 1 An Introduction to Digital Preservation Make Plans to Manage Content and Provide Access Over Time (Last of 3 ASERL Webinars) February 21, 2011 Jody.
Preservation – Why the Urgency? “A National Library is a place where a nation nourishes its memory and exerts its imagination – where it connects with.
Reference Model for an Open Archival Information System (OAIS) ESIP Summer Meeting John Garrett – ADNET Systems at NASA/GSFC ESIP Summer Meeting.
OAIS in the Library Environment Managing and Preserving Electronic Resources FLICC/CENDI Washington DC, December 11,2001 Anne Van Camp RLG, Member Initiatives.
DigCCurr Professional Institute: Curation Practices for the Digital Object Lifecycle Digital Curation Program Development Nancy Y McGovern Research Assistant.
DAITSS: Dark Archive in the Sunshine State Priscilla Caplan, Florida Center for Library Automation DCC Workshop on Long-term Curation within Digital Repositories.
Mr. Gopi Nair Defense Technical Information Center Briefing at Board on Research Data and Information (BRDI) Meeting September 24, 2009 Approved for Public.
Digital Preservation: Current Thinking Anne Gilliland-Swetland Department of Information Studies.
Archival Workshop on Ingest, Identification, and Certification Standards Certification (Best Practices) Checklist Does the archive have a written plan.
Metadata for digital preservation: a review of recent developments Michael Day UKOLN, University of Bath ECDL2001, 5th European Conference.
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
DRAFT EDMC Procedural Directives NOAA Environmental Data Management Committee 12/3/2015 1
APT Trustworthy Digital Repository / Certification Working Group Progress Report, October 2015 Stephen Paul Davis, Columbia University Libraries.
International Atomic Energy Agency Roles and responsibilities for development of disposal facilities Phil Metcalf Workshop on Strategy and Methodologies.
NDSR Boston webinar: Digital Preservation Introduction Presenter: Nancy Y McGovern October 2015.
Preserving Electronic Mailing Lists as Scholarly Resources: The H-Net Archives Lisa M. Schmidt
Aligning Digital Preservation Policies with Community Standards Nancy McGovern Digital Preservation Officer.
Managing Access at the University of Oregon : a Case Study of Scholars’ Bank by Carol Hixson Head, Metadata and Digital Library Services
June 21, 2011EDMC Workshop in Silver Spring, MDDan Kowal Submission Agreements: The role they play in supporting the relationship between the Data Producer/Provider.
The OAIS Reference Model and Trustworthy Repositories Josh Lubell Manufacturing Engineering Laboratory NIST
Institutional Repositories July 2007 DIGITAL CURATION creating, managing and preserving digital objects Dr D Peters DISA Digital Innovation South.
SEDAC Long-Term Archive Development Robert R. Downs Socioeconomic Data and Applications Center Center for International Earth Science Information Network.
The OAIS model SEEDS meeting May 5 th, 2015, Lausanne Bojana Tasic.
Cedars work on metadata Michael Day UKOLN, University of Bath Cedars Workshop Manchester, February 2002.
Data Management and Digital Preservation Carly Dearborn, MSIS Digital Preservation & Electronic Records Archivist
OAIS (archive) Producer Management Consumer. Representation Information Data Object Information Object Interpreted using its Yields.
DP Knowhow: Introduction to Audit and Certification in ISO APARSEN-EGI Community Workshop on Managing, Computing and Preserving Big Data for Research.
OAIS (archive) OAIS (archive) Producer Management Consumer.
Criteria for Assessing Repository Trustworthiness: An Assessment
Trusted Repository Systems Overview
OAIS Producer (archive) Consumer Management
Certification of Trusted Repositories
D33.1B PEER REVIEW OF DIGITAL REPOSITORIES
Building A Repository for Digital Objects
DAITSS: Dark Archive in the Sunshine State
Trustworthiness of Preservation Systems
2. ISO Certification Discussed already at 2015 PoW and several WLCG OB meetings Proposed approach: An Operational Circular that describes the organisation's.
Audit and Certification of Institutional Repositories
Sophia Lafferty-hess | research data manager
Certifying Preservation Actions - TRAC and related initiatives
Certifying Preservation Actions - TRAC and related initiatives
Robin Dale RLG OAIS Functionality Robin Dale RLG
Presentation transcript:

May 16, 2012EDMC Workshop in College Park MDDan Kowal Trusted Digital Repositories: A New Audit Standard A Follow-on to the OAIS Dan Kowal, Data Administrator, NGDC Digital Preservation and Nuclear Disaster: An Animation

May 16, 2012EDMC Workshop in College Park MDDan Kowal OAIS Framework

May 16, 2012EDMC Workshop in College Park MDDan Kowal Trustworthiness Why an Audit? OAIS Archive ProvidersUsers Other Stakeholders

May 16, 2012EDMC Workshop in College Park MDDan Kowal Audit and Certification of Trustworthy Digital Repositories ISO Standard XXXXX TDR: ISO

May 16, 2012EDMC Workshop in College Park MDDan Kowal TDR Definition At the very basic level, the definition of a trustworthy digital repository must start witha mission to provide reliable, long-term access to managed digital resources to its Designated Community, now and into the future.

May 16, 2012EDMC Workshop in College Park MDDan Kowal Audit Structure Organizational Infrastructure Digital Object Management Infrastructure and Security Risk Management.

May 16, 2012EDMC Workshop in College Park MDDan Kowal Organizational Infrastructure Governance & Organizational Viability Organizational Structure & Staffing Procedural Accountability & Preservation Policy Framework. Financial Sustainability Contracts, Licenses & Liabilities.

May 16, 2012EDMC Workshop in College Park MDDan Kowal Digital Object Management Ingest: Acquisition of Content Ingest: Creation of the AIP Preservation Planning AIP Preservation Information Management Access Management

May 16, 2012EDMC Workshop in College Park MDDan Kowal Risk Management Technical Infrastructure Risk Management. Security Risk Management.

May 16, 2012EDMC Workshop in College Park MDDan Kowal Discussions with Data Managers Reviewed examples of TDR criteria. Internal vs. External audit. Surface vs. Deep Dive. TDR Checklist Eval. for the DOM.

May 16, 2012EDMC Workshop in College Park MDDan Kowal TDR Checklist Eval. Do the DMs understand the criteria? –45 DOM criteria / 37 for DMs. –Discussed some in depth at DM Mtg. –One confirmed reading support doc. –One 1-on-1 session with DM. –3 weeks given to review criteria – flag those they dont understand. –

May 16, 2012EDMC Workshop in College Park MDDan Kowal Results of TDR Eval 6 DMs responded Most tried to evaluate their data sets. What dont you understand? –No indication by two DMs. They only made it through half the questions. –1 to 11 questions flagged. 1 DM did not submit spreadsheet results: –evaluation criteria not particularly clear –It appears that the DOM portion of TDR Certification is very narrowly directed at the OAIS…and not necessarily applicable to the broad and varied world of data management systems at NGDC.

May 16, 2012EDMC Workshop in College Park MDDan Kowal Next Steps Clarify Criteria Further. Remove some of the Criterion? What dont apply? Expectations for assessment feedback. Implementation plan for the audit. –Pick a few data sets. –Include in the data migration to CLASS. Answer the first question: Is TDR certification in NGDCs best interest?

May 16, 2012EDMC Workshop in College Park MDDan Kowal Org. Infrastructure Example. 1.The repository shall have a mission statement that reflects a commitment to the preservation of, long term retention of, management of, and access to digital information. 2.The repository shall have a Preservation Strategic Plan that defines the approach the repository will take in the long-term support of its mission. 3.The repository shall have a Collection Policy or other document that specifies the type of information it will preserve, retain, manage and provide access to.

May 16, 2012EDMC Workshop in College Park MDDan Kowal Org. Infrastructure Metric Ex.:

May 16, 2012EDMC Workshop in College Park MDDan Kowal Org. Infrastructure Metric Ex. 2:

May 16, 2012EDMC Workshop in College Park MDDan Kowal Digital Object Element Ex.:

May 16, 2012EDMC Workshop in College Park MDDan Kowal TDR characteristics 108 audit metrics. TDR Board Approves, Audit Teams has to have certifiable credentials. Bi-directional connections emphasized. PDI Representation Info Emphasized.

May 16, 2012EDMC Workshop in College Park MDDan Kowal TDR Audit Eval. Form AspectCriterionExplanationOccurs (Y/N)Evidence B.5 Information Management B5.2 Repository captures or creates minimum descriptive metadata and ensures that it is associated with the archived object (i.e., AIP). Does the Archive receive its required metadata from the Data Provider or does it supply some metadata itself during ingest?Y Archive usually creates its own metadata. Some exceptions occur where the originator supplies metadata. B.2 Ingest: creation of the archivable package B2.7. Repository demonstrates that it has access to necessary tools and resources to establish authoritative semantic or technical context of the digital objects it contains (i.e., access to appropriate international Representation Information and format registries). Do your file formats subscribe to well known standards that are referenced in a technical repository that defines the format and the tools to access them?Y/N That depends on the dataset. Data in the Index to Marine and Lacustrine Geological Samples, the "073" grainsize database, and the DSDP/ODP/IODP datasets all conform to well established, well documented standards.

May 16, 2012EDMC Workshop in College Park MDDan Kowal References Center for Research Libraries – TDR –Audit ChecklistAudit Checklist –ISO 16919, entitled, Requirements for Bodies providing Audit and CertificationISO 16919, entitled, Requirements for Bodies providing Audit and Certification Primary Trustworthy Digital Repository Download the ISO Standard

May 16, 2012EDMC Workshop in College Park MDDan Kowal Archive Audit -Summary 21 How well does NGDC comply to the Open Archive Information System Standard? Trusted Digital Repository Audit Certification - ISO 16363:2012 Defines a recommended practice for assessing the trustworthiness of digital repositories Three Stage Process: -Self Audit -External Audit Team Review -Audit Team Final Report Audit Covers: Organizational Structure Digital Object ManagementInfrastructure and Security Risk 25 Measures45 Measures17 Measures e.g. Repository has the appropriate number of staff to support all functions and services. e.g. Repository identifies properties it will preserve for digital objects. e.g. Repository manages the number and location of copies of all digital objects. Status: -STP Deep Dive Review in TDR Education Overview in Documentation Collection in 2012