Odum Institute iRODS Policies to Support Preservation

Slides:



Advertisements
Similar presentations
Panel 2 – Promoting Re-Use of Scientific Collections John Harrison SHAMAN Project University of Liverpool
Advertisements

A Community Approach to Preservation: Experiences with Social Science Data ASIST Summit 2010 Jonathan Crabtree April 9, 2010.
Introduction to Planets Hans Hofman Nationaal Archief Netherlands Prague, 17 October 2008.
CACORE TOOLS FEATURES. caCORE SDK Features caCORE Workbench Plugin EA/ArgoUML Plug-in development Integrated support of semantic integration in the plugin.
Current impacts of cloud migration on broadband network operations and businesses David Sterling Partner, i 3 m 3 Solutions.
© 2014 Cognizant 4 th March 2015 MBaaS: Mobile Backend as a Service Pablo Gutiérrez / Senior Mobility developer.
A Very Brief Introduction to iRODS
Sustainable Preservation Services for Archivists through Distributed Custody Caryn Wojcik State of Michigan Records Management Services.
Funded by: © AHDS Sherpa DP – a Technical Architecture for a Disaggregated Preservation Service Mark Hedges Arts and Humanities Data Service King’s College.
Micah Altman MIT Libraries Jonathan Crabtree Odum Institute UNC Chapel Hill Prepared for Aligning Digital Preservation across Nations Amsterdam 2013 Website:
Title Subtitle. Building Relationships: “A Foundation for Digital Archives” Digital Object Repository Systems in Digital Libraries (DORSDL) September.
A Community Approach to Preservation: “Experiences with Social Science Data” Community Approaches to Digital Preservation 2009 Jonathan Crabtree February.
Surfing the Data Standards: Colorado’s Path 2012 MIS Conference – San Diego Daniel Domagala, Colorado Department of Education David Butter, Deloitte Consulting.
Richard MARCIANO Chien-Yi HOU School of Information and Library Science (SILS) Sustainable Archives & Leveraging Technologies Group (SALT) University of.
SOAPI: a flexible toolkit for implementing ingest and preservation workflows Mark Hedges Centre for e-Research, King’s College London Arts and Humanities.
Database Application Application logic: presentation (input /output)
A DAPT IST Composite Services Gustavo Alonso Swiss Federal Institute of Technology (ETHZ) Zürich, Switzerland.
Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.
DCAPE Distributed Custodial Archival Preservation Environments ( Chien-Yi HOU Richard MARCIANO UNC Chapel Hill, SILS /
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
Tools and Services for the Long Term Preservation and Access of Digital Archives Joseph JaJa, Mike Smorul, and Sangchul Song Institute for Advanced Computer.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation Mike Smorul, Joseph JaJa, Yang Wang, and Fritz McCall.
Richard MARCIANO Chien-Yi HOU School of Information and Library Science (SILS) Sustainable Archives & Leveraging Technologies Group (SALT) University of.
A simpler way to manage identities across multiple services Aldo Zanoni, CEO ext. 232
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
Data-PASS Shared Catalog Micah Altman & Jonathan Crabtree 1 Micah Altman Harvard University Archival Director, Henry A. Murray Research Archive Associate.
Towards an Integrated Transparent Journal Publishing Workflow
DCC Conference, Glasgow November, Digital Archive Policies and Trusted Digital Repositories MacKenzie Smith, MIT Libraries Reagan Moore, San Diego.
Working Group: Practical Policy Rainer Stotzka, Reagan Moore.
Persistent Digital Archives and Library System (PeDALS) SC Department of Archives and History.
OASIS ebXML Registry Standard Open Forum 2003 on Metadata Registries 10:30 – 11:15 January 20, 2003 Kathryn Breininger The Boeing Company Chair, OASIS.
XML in Development of Distributed Systems Tooling Programming Runtime.
Cloud Task Replica Repository Preservation Tools Open Repositories Atlanta Richard Rodgers MIT Libraries.
Rule-Based Data Management Systems Reagan W. Moore Wayne Schroeder Mike Wan Arcot Rajasekar {moore, schroede, mwan, {moore, schroede, mwan,
Data curation in an existing infrastructure: Stellenbosch University 1 st African Digital Curation Conference 12 – 13 February 2008 Wouter Klapwijk Senior.
Microsoft and Community Tour 2011 – Infrastrutture in evoluzione Community Tour 2011 Infrastrutture in evoluzione.
Preserving Digital Collections for Future Scholarship Oya Y. Rieger Cornell University
Richard MarcianoChien-Yi Hou Caryn Wojcik University of University of State of Michigan North Carolina North Carolina Records Management ServicesSALT DCAPE.
Production Data Grids SRB - iRODS Storage Resource Broker Reagan W. Moore
PSI Peer Search Infrastructure. Introduction What are P2P Networks? The term "peer-to-peer" refers to a class of systems and applications that employ.
Integrating Automated Data Deposit into the Journal Publishing Workflow Eleni Castro, Research Coordinator > IQSS Harvard Digital Publishing Collaborative,
Rule-Based Preservation Systems Reagan W. Moore Wayne Schroeder Mike Wan Arcot Rajasekar Richard Marciano {moore, schroede, mwan, sekar,
Policy Based Data Management Data-Intensive Computing Distributed Collections Grid-Enabled Storage iRODS Reagan W. Moore 1.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Jonathan Crabtree Assistant Director of Computing and Archival Research UNC Chapel Hill, Odum Institute Vision for Sociometric Analysis of Long-tail Science.
Master Data Management & Microsoft Master Data Services Presented By: Jeff Prom Data Architect MCTS - Business Intelligence (2008), Admin (2008), Developer.
NDSR Boston webinar: Digital Preservation Introduction Presenter: Nancy Y McGovern October 2015.
Millman—Nov 04—1 An Update on Digital Libraries David Millman Director of Research & Development Academic Information Systems Columbia University
Cloud Computing Use Case Draft v2.
National Science Foundation Cooperative Agreement: OCI Reagan Moore, PI Mary Whitton, Project Manager.
©MIT LKTR Workshop, Digital Archive Policies and Trusted Digital Repositories MacKenzie Smith, MIT Libraries Reagan Moore, San Diego Supercomputer.
1 Documentation Progression Send To Standard Document Library Document Center – Drop Off Library – Rules Based on Content Type and Metadata routes files.
OASIS ebXML Registry Standard Open Forum 2003 on Metadata Registries 10:30 – 11:15 January 20, 2003 Kathryn Breininger The Boeing Company Chair, OASIS.
Rights Management for Shared Collections Storage Resource Broker Reagan W. Moore
Digital Asset Management Systems and Digital Preservation EUAN COCHRANE – DIGITAL PRESERVATION MANAGER YALE UNIVERSITY LIBRARY.
Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.
GEO Data Management Principles Implementation : World Data System–Data Seal of Approval (WDS-DSA) Core Certification of Digital Repositories Dr Mustapha.
Setting up long term digital preservation DLM Forum Member Meeting Luxembourg 14-15th October 2015.
Enhancements to Galaxy for delivering on NIH Commons
NDS Labs and Dataverse:
DataNet Collaboration
An Overview of Data-PASS Shared Catalog
Policy-Based Data Management integrated Rule Oriented Data System
Joseph JaJa, Mike Smorul, and Sangchul Song
Overview: Fedora Architecture and Software Features
What Is Sharepoint? Mohsen Ashkboos
Sophia Lafferty-hess | research data manager
Wavestore Integrates…
Scheduled Accomplishments
Repository Platforms for Research Data Interest Group: Requirements, Gaps, Capabilities, and Progress Robert R. Downs1, 1 NASA.
Presentation transcript:

Odum Institute iRODS Policies to Support Preservation Dataverse Community Meeting 2016 Jonathan Crabtree Reagan Moore Don Sizemore

Odum DFC Project Goals Design curation/preservation workflow integration Connect research environment with archive Connect archive with national architecture Policy based Open source focused As “pluggable” as possible 2

Bringing great tools together iRODS Dataverse BitCurator Preservation Audit Standards ISO 16363 Data Seal of Approval 3

Application Workflow Dataverse Preservation Federation files Dataverse irsync.sh Dataverse Local iRODS Bitcurator.r Archive.r

Preservation Policy Enforcement Odum Current Production Efforts iRODS configured to utilize BitCurator Testing sensitive information identification utilizing iRODS/BitCurator/BulkExtractor Selected ISO 16363 policies implemented with iRODS rules Rules published to GitHub Utilizing irsync client/server method to push data from Odum Dataverse to iRODS and policies to archive data in DFC Integrated staging iRODS server to traverse UNC Firewall

Leveraging iRODS Automate preservation actions Rule based policy management Scalable storage infrastructure Enhances secure data sharing possibilities Diversifies Dataverse storage options 6

Project Next Steps Stress test sensitive information identification and valid file formats Add more complex sensitive information formats Expand iRODS rules based policy reporting Complete testing of iRODS/Modeshape/Dataverse integration Enable Dataverse/iRODS metadata lookup 7

Links http://dx.doi.org/10.7910/DVN/ITNETO https://github.com/DICE-UNC/dfc-dataverse-integration https://github.com/DICE-UNC/indexing-irods https://github.com/akio-sone/dvn/tree/Odum-Ext https://github.com/donsizemore/odum/tree/master/irods_rules http://datafed.org http://www.odum.unc.edu/odum/home2.jsp http://Dataverse.org 8

Thanks! Jonathan Crabtree Jonathan_Crabtree@unc.edu Follow us on Twitter @Odum_Institute Subscribe to our Channel The Odum Institute Our Website www.odum.unc.edu