RDA/WDS IG Certification of Digital Repositories The new 'Core Trustworthy Data Repository Requirements' hands-on RDA Plenary 9, Barcelona, 05-04-2017.

Slides:



Advertisements
Similar presentations
Criteria for the trustworthiness of data centres Jens Klump Helmholtz Centre Potsdam German Research Centre for Geosciences (GFZ) DataCite Summer Meeting.
Advertisements

Peer-Reviewer Guidance Data Seal of Approval Hervé L’Hours DSA Conference Amsterdam. 24 September, 2014.
ICPSR and the Data Seal of Approval: A Case Study Mary Vardigan Assistant Director, ICPSR October 8, 2013.
Data Archiving and Networked Services DANS is an institute of KNAW en NWO Trusted Digital Archives and the Data Seal of Approval Matthias Hemmje (FTK)
By Eileen Clegg Digital Preservation at Columbia in the Old Days (2009)
TRAC / TDR ICPSR Trustworthy Digital Repositories.
Data Seal of Approval Overview Lightning Talk RDA Plenary 5 – San Diego March 11, 2015 Mary Vardigan University of Michigan Inter-university Consortium.
DANS is an institute of KNAW and NWO Data Archiving and Networked Services DSA and CESSDA Heiko Tjalsma Policy Advisor DANS Data Seal of Approval Conference.
© The Association of Independent Schools of NSW Preparing for the ASQA Audit.
Who is doing a good job in digital preservation? Audit and Certification of Digital Repositories: ISO and the European Framework.
Internal Auditing and Outsourcing
Walkthrough Data Seal of Approval Hervé L’Hours DSA Conference 2012.
Science Archives in the 21st Century 25/26 April Towards an International standard for Audit and Certification of Digital Repositories David Giaretta.
Repository Requirements and Assessment August 1, 2013 Data Curation Course.
Data Archiving and Networked Services DANS is an institute of KNAW en NWO Trusted Digital Archives and the Data Seal of Approval Peter Doorn Data Archiving.
Data Archiving and Networked Services DANS is an institute of KNAW en NWO and the Peter Doorn Data Archiving and Networked Services EUDAT Conference Trust.
Repository Audit and Certification DSA–WDS Partnership WG RDA Working Groups Meeting at NIST November 13-14, 2014.
Nestor – German network of expertise in digital preservation nestor German Network of Expertise in Digital Preservation nestor.
DigCCurr Professional Institute: Curation Practices for the Digital Object Lifecycle Digital Curation Program Development Nancy Y McGovern Research Assistant.
FOURTH EUROPEAN QUALITY ASSURANCE FORUM "CREATIVITY AND DIVERSITY: CHALLENGES FOR QUALITY ASSURANCE BEYOND 2010", COPENHAGEN, NOVEMBER IV FORUM-
Archival Workshop on Ingest, Identification, and Certification Standards Certification (Best Practices) Checklist Does the archive have a written plan.
NDSR Boston webinar: Digital Preservation Introduction Presenter: Nancy Y McGovern October 2015.
PHE portal update Anne Brice Mahesh Patel. PHE portal Progress so far Relationship between AKM and Online Services workstreams Engaging with content users.
SEEDS: Programme and Objectives SEEDS Kick-off meeting May 4, Lausanne Renate Kunz.
The OAIS Reference Model and Trustworthy Repositories Josh Lubell Manufacturing Engineering Laboratory NIST
SEDAC Long-Term Archive Development Robert R. Downs Socioeconomic Data and Applications Center Center for International Earth Science Information Network.
RDA, 5th Plenary, San Diego WDS Certification Objective: building trust in the usage of data & data services Michael Diepenbroek Rorie Edmunds Mustapha.
Building Capacities for Establishment of Social Science Digital Data Archives Aleksandra Bradić-Martinović, Institute of Economic Sciences, Belgrade Achievements.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Webinar on Trust.
GEO Data Management Principles Implementation : World Data System–Data Seal of Approval (WDS-DSA) Core Certification of Digital Repositories Dr Mustapha.
DP Knowhow: Introduction to Audit and Certification in ISO APARSEN-EGI Community Workshop on Managing, Computing and Preserving Big Data for Research.
SciDataCon 2014, WDS Forum, Dehli WDS Certification Objective: building trust in the usage of data & data services Michael Diepenbroek Rorie Edmunds Mustapha.
DSA & WDS WG Certification RDA Outputs: Munich 20 February 2015.
GEOSS Data Management Principles Implementation: Core Trustworthy Data Repository certification Michael Diepenbroek PANGAEA Wim Hugo NRF/SAEON Mustapha.
Core Certification for Trustworthy Data Repositories
CESSDA SaW Training on Trust, Identifying Demand & Networking
FAIR Data in Trustworthy Data Repositories:
Audit & Certification with ISO standards
2nd DPHEP Collaboration Workshop
Legacy and future of the World Data System (WDS) certification of data services and networks Dr Mustapha Mokrane, Executive Director, WDS International.
Digital Repository Certification Schema A Pathway for Implementing the GEO Data Sharing and Data Management Principles Robert R. Downs, PhD Sr. Digital.
Auditing of Trustworthy Data Repositories – Speakers
Criteria for Assessing Repository Trustworthiness: An Assessment
ISO/IEC
Preparing a Trustworthy Domain Repository for ISO Certification
Trusted Repository Systems Overview
Developing Criteria to Establish Trusted Digital Repositories
Certification of Trusted Repositories
DSA–WDS Partnership: Streamlining the landscape of data repository certification Lesley Rickards, Mary Vardigan, Ingrid Dillo, Françoise Genova, Hervé.
D33.1B PEER REVIEW OF DIGITAL REPOSITORIES
DANS Certification Efforts Use Case
Trustworthiness of Preservation Systems
RDA Plenary 7, Tokyo, 3 March 2016,
SEEDS Kick-off meeting May 6, Lausanne Bojana Tasic Renate Kunz
Auditor Training Module 1 – Audit Concepts and Definitions
Peer-Reviewer Perspective Data Seal of Approval
Data Preservation Update Data Preservation, Curation & Stewardship
DNV experiences and viewpoints
Identifiers Answer Questions
Audit and Certification of Institutional Repositories
Setting Actuarial Standards
HIGHLIGHTING THE KEY CHANGES
USING THE DSA TO BENCHMARK AND GUIDE TRUST WITHIN CESSDA
Sophia Lafferty-hess | research data manager
EOSCpilot Skills Landscape & Framework
Independent Internal Audit Quality Reviews
Certifying Preservation Actions - TRAC and related initiatives
WHAT TO EXPECT: A CROWN CORPORATION’S GUIDE TO A SPECIAL EXAMINATION
Bird of Feather Session
RDA adoption story on CoreTrustSeal certification
Presentation transcript:

RDA/WDS IG Certification of Digital Repositories The new 'Core Trustworthy Data Repository Requirements' hands-on RDA Plenary 9, Barcelona, 05-04-2017

The new 'Core Trustworthy Data Repository Requirements' hands-on Meeting aim Hands-on experience with the Core Requirements for TDR certification https://www.rd-alliance.org/wds-and-dsa-announce-unified-requirements-co... Meeting agenda Updates from certification standards communities (10 minutes) Brief introduction of the requirements (10 minutes) Evaluation of evidence information and desirable linked evidence in break-out groups (40 minutes) Round-table discussion (30 minutes)

Core Level Certification DSA-WDS alignment: Core requirements published Common assessment procedure in place Ad-hoc Board to guide transition towards a new core level standards and certification entity before the end of this year Activities of the ad-hoc Board: Governance Business model Corporate branding, including name, logo, website, etc. Applicant and reviewer guidance Common online tool for assessment and review Communications www.datasealofapproval.org/en/news-and-events/news/2017/3/30/new-standards-and-certification-entity-horizon/ www.icsu-wds.org/news/news-archive/new-standards-and-certification-entity-on-the-horizon

A new branding for the Core TDR certification Represent our values: trustworthiness, baseline requirements Timeless, simple, distinctive, short, clear, works worldwide… Branding for: Certification body Certified product(s) Two options are being considered: comments and feedback welcome! >> CoreTrust << >> TrustSeal << CoreTrust – Repository (CT-R) CoreTrust – Software (CT-S) CoreTrust – Data (CT-D)… TrustSeal – Repository (TS-R) TrustSeal – Software (TS-S) TrustSeal – Data (TS-D)…

Extended certification: nestorSeal 2016 2 positive assessments: German National Library Data Archiving and Networked Services (DANS) ( assessment in English) Based on the experience of these assessments the evaluation process was improved; published as Version 2 of the Explanatory Notes (in German) Publication of the submission form (in German) 2017 Several assessments are currently being evaluated Translation of the submission form into English Translation of the Explanatory Notes in other languages in preparation (Dutch, Czech) For more information: http://www.langzeitarchivierung.de/Subsites/nestor/EN/Siegel/siegel_node.html Contact: nestorsiegel@langzeitarchivierung.de

Formal certification: ISO 16363 ISO 16363 guides auditors in making a judgement about whether or not a repository can be trusted to play its part in preserving digitally encoded information, following OAIS concepts. There are many metrics (requirements). These are arranged hierarchically to ensure that an auditor is forced to examine all relevant aspects of the repository in the appropriate depth ISO 16919:2014 specifies requirements for bodies providing ISO 16363 audit and certification – provide detailed competences that auditors need. 16919 specialises ISO 17021, the fundamental standard for audit and certification Fully integrated into the worldwide ISO audit process on which we all depend – based on ISO 17021:2015. Auditors need specialised general skills as well as specific knowledge of ISO 16363.

Formal certification: ISO 16363 The first application for accreditation by a National Accreditation Body is underway. Process includes office assessments and witnessed audits First accreditation is expected in the next few weeks. OAIS and 16363 published by ISO in 2012. Update process is underway – see http://review.oais.info. Updated documents expected to be published in 2019/20.

Core TDR requirements Context (1) Organizational infrastructure (6) Digital object management (8) Technology (2) Additional information and applicant feedback (1)

Organisational infrastructure R1. The repository has an explicit mission to provide access to and preserve data in its domain. R2. The repository maintains all applicable licenses covering data access and use and monitors compliance. R3. The repository has a continuity plan to ensure ongoing access to and preservation of its holdings. R4. The repository ensures, to the extent possible, that data are created, curated, accessed, and used in compliance with disciplinary and ethical norms. R5. The repository has adequate funding and sufficient numbers of qualified staff managed through a clear system of governance to effectively carry out the mission. R6. The repository adopts mechanism(s) to secure ongoing expert guidance and feedback (either in-house, or external, including scientific guidance, if relevant).

Digital object management (1) R7. The repository guarantees the integrity and authenticity of the data. R8. The repository accepts data and metadata based on defined criteria to ensure relevance and understandability for data users. R9. The repository applies documented processes and procedures in managing archival storage of the data. R10. The repository assumes responsibility for long-term preservation and manages this function in a planned and documented way.

Digital object management (2) R11. The repository has appropriate expertise to address technical data and metadata quality and ensures that sufficient information is available for end users to make quality-related evaluations. R12. Archiving takes place according to defined workflows from ingest to dissemination. R13. The repository enables users to discover the data and refer to them in a persistent way through proper citation. R14. The repository enables reuse of the data over time, ensuring that appropriate metadata are available to support the understanding and use of the data.

Technical infrastructure R15. The repository functions on well-supported operating systems and other core infrastructural software and is using hardware and software technologies appropriate to the services it provides to its Designated Community. R16. The technical infrastructure of the repository provides for protection of the facility and its data, products, services, and users.

Review procedure Self assessment in online tool Guidance text available Review by two reviewers: URLs to evidence strongly encouraged Maturity ratings strongly encouraged Successful assessments publicly available by default Renewals every three years

Some results of the CESSDA Trust and Certification Working Group so far In particular based on the CESSDA Workshop in Zagreb, 1-2 March 2017

Tasks CESSDA Trust Working group (DANS, GESIS, UKDA, FSD, ADP) Advisory body on DSA and obligations of the CESSDA Statutes Monitoring status certifications Advising the SP’s (continuing Trust workshops) Role in training Contact with certification boards

Results in Zagreb: what we did 15 Self-Assessments have been sent in! Reviewed by the 5 members of the CESSDA Trust Group Each self-assessment reviewed by two reviewers Compliance levels given:1-4 Comments made

Main conclusions Results varying between and in service providers Both for the “old” and “new” service providers Providing evidence clearly is the weakest point Some service providers are simply not yet in a position to become DSA/WDS compliant

Lowest scores REQUIREMENT XVI Security XV Technical infrastructure III Continuity of access IX Documented storage procedures X Preservation plan

Lowest scores XV. Technical infrastructure The repository functions on well-supported operating systems and other core infrastructural software and is using hardware and software technologies appropriate to the services it provides to its Designated Community. XVI. Security The technical infrastructure of the repository provides for protection of the facility and its data, products, services, and users. III. Continuity of access The repository has a continuity plan to ensure ongoing access to and preservation of its holding IX. Documented storage procedures The repository applies documented processes and procedures in managing archival storage of the data. X. Preservation plan The repository assumes responsibility for long term preservation and manages this function in a planned and documented way.

Highest scores REQUIREMENT I Mission / Scope XIV Data reuse VI Expert guidance IV Confidentiality / Ethics

Highest scores I. Mission/Scope The repository has an explicit mission to provide access to and preserve data in its domain. XIV. Data reuse The repository enables reuse of the data over time, ensuring that appropriate metadata are available to support the understanding and use of the data. VI. Expert guidance The repository adopts mechanism(s) to secure ongoing expert guidance and feedback (either in-house, or external, including scientific guidance, if relevant) IV. Confidentiality/Ethics The repository ensures, to the extent possible, that data are created, curated, accessed, and used in compliance with disciplinary and ethical norms.

Breakout sessions Materials: Requirements Self assessment GESIS based on the requirements Questions: Considering the guidance provided, is the evidence information provided suitable? What type of evidence can/is best documented in the self-assessment? What type of evidence can/is best linked to a public document? Can the guidance be improved?