Working Group: Practical Policy Rainer Stotzka, Reagan Moore.

Slides:



Advertisements
Similar presentations
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.
Advertisements

GFS OGF-22 Global Resource Naming Developers: Reagan Moore Arcot Mike.
OGF-23 iRODS Metadata Grid File System Reagan Moore San Diego Supercomputer Center.
© 2006 Open Grid Forum OGF19 Federated Identity Rule-based data management Wed 11:00 AM Mountain Laurel Thurs 11:00 AM Bellflower.
An Introduction to Repositories Thornton Staples Director of Community Strategy and Alliances Director of the Fedora Project.
Interoperability Scenarios All Working Groups Meeting May, Rome, Italy.
A Very Brief Introduction to iRODS
Dr Gordon Russell, Napier University Unit Data Dictionary 1 Data Dictionary Unit 5.3.
Trustworthy Repository Criteria, Virtual Organizations, and Infrastructure MacKenzie Smith, MIT Libraries NDIIPP Meeting, July 2010.
TRAC / TDR ICPSR Trustworthy Digital Repositories.
Extracting and Ingesting DDI Metadata and Digital Objects from a Data Archive into the iRODS extension of the NARA TPAP Using the OAI-PMH J. Ward, A. de.
Connecting People With Information DoD Net-Centric Services Strategy Frank Petroski October 31, 2006.
CMS 01_0171_igs- 1 Moving SECOORA Forward Conceptual Design of an Enterprise Architectural Framework Fact and Speculation 13 September 2006 Carroll A.
GGF-17 Astro Workshop Preservation Environment Working Group Officers: Bruce Barkstrom (NASA Langley) Reagan Moore (SDSC) Goals  Demonstrate.
Brief Overview of Major Enhancements to PAWN. Producer – Archive Workflow Network (PAWN) Distributed and secure ingestion of digital objects into the.
Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
UMIACS PAWN, LPE, and GRASP data grids Mike Smorul.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation Mike Smorul, Joseph JaJa, Yang Wang, and Fritz McCall.
National Science Foundation Cooperative Agreement: OCI
Update on INSPIRE: INSPIRE maintenance and implementation and INSPIRE related EEA activities on biodiversity CDDA/European protected areas technical meeting.
DCC Conference, Glasgow November, Digital Archive Policies and Trusted Digital Repositories MacKenzie Smith, MIT Libraries Reagan Moore, San Diego.
The Data Attribution Abdul Saboor PhD Research Student Model Base Development and Software Quality Assurance Research Group Freie.
DATA FOUNDATION TERMINOLOGY WG 4 th Plenary Update THE PLUM GOALS This model together with the derived terminology can be used Across communities and stakeholders.
Lecture 8 Inheritance Richard Gesick. 2 OBJECTIVES How inheritance promotes software reusability. The concepts of base classes and derived classes. To.
National Data Infrastructure Projects EarthCube Layered Architecture (GEO) DataNet Federation Consortium (OCI) integrated Rule Oriented Data System (SDCI)
San Diego Supercomputer CenterUniversity of California, San Diego Preservation Research Roadmap Reagan W. Moore San Diego Supercomputer Center
Information Management and Distributed Data Reagan W. Moore Wayne Schroeder Mike Wan Arcot Rajasekar Richard Marciano {moore, schroede, mwan, sekar,
THE GITB TESTING FRAMEWORK Jacques Durand, Fujitsu America | December 1, 2011 GITB |
USING METADATA TO FACILITATE UNDERSTANDING AND CERTIFICATION ABOUT THE PRESERVATION PROPERTIES OF A PRESERVATION SYSTEM Jewel H. Ward, Hao Xu, Mike C.
PERG OGF-22 Preservation Environments Research Group Organizers: Reagan Moore Richard Marciano
METADATA QUALITY IN EUROPEANA , Den Haag.
Rule-Based Data Management Systems Reagan W. Moore Wayne Schroeder Mike Wan Arcot Rajasekar {moore, schroede, mwan, {moore, schroede, mwan,
1 integrated Rule Oriented Data System Tutorial: iRODS Capabilities.
Production Data Grids SRB - iRODS Storage Resource Broker Reagan W. Moore
Topic Rathachai Chawuthai Information Management CSIM / AIT Review Draft/Issued document 0.1.
Statistics New Zealand’s End-to-End Metadata Life-Cycle ”Creating a New Business Model for a National Statistical Office if the 21 st Century” Gary Dunnet.
Working Group Practical Policy based on slides and latest documents from the PP WG chaired by Reagan Moore, Rainer Stotzka presented by Johannes Reetz.
Rule-Based Preservation Systems Reagan W. Moore Wayne Schroeder Mike Wan Arcot Rajasekar Richard Marciano {moore, schroede, mwan, sekar,
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Persistent Management of Distributed Data Reagan W. Moore.
FEA DRM Management Strategy Presented by : Mary McCaffery, US EPA.
Archival Workshop on Ingest, Identification, and Certification Standards Certification (Best Practices) Checklist Does the archive have a written plan.
Policy Based Data Management Data-Intensive Computing Distributed Collections Grid-Enabled Storage iRODS Reagan W. Moore 1.
How to Implement an Institutional Repository: Part II A NASIG 2006 Pre-Conference May 4, 2006 Technical Issues.
From SRB to IRODS: Policy Virtualization using Rule-Based Data Grids Reagan W. Moore Wayne Schroeder Arcot Rajasekar Mike Wan San Diego Supercomputer Center.
GGF-17 Preservation Environments Research Group Preservation Environment Working Group Officers: Bruce Barkstrom (NASA Langley) Reagan.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No The pan-European.
Collecting History: Profiles in Science Alexa T. McCray National Library of Medicine Bethesda, MD Stanford University August 21, 1999.
National Science Foundation Cooperative Agreement: OCI
M-1 INGEST OVERVIEW Don Sawyer National Space Science Data Center NASA/GSFC October 13, 1999.
National Science Foundation Cooperative Agreement: OCI Reagan Moore, PI Mary Whitton, Project Manager.
EO Dataset Preservation Workflow Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.
©MIT LKTR Workshop, Digital Archive Policies and Trusted Digital Repositories MacKenzie Smith, MIT Libraries Reagan Moore, San Diego Supercomputer.
National Archives and Records Administration1 Integrated Rules Ordered Data System (“IRODS”) Technology Research: Digital Preservation Technology in a.
Data Foundation IG DF Organizing Chairs: Gary Berg-Cross & Peter Wittenburg.
Rights Management for Shared Collections Storage Resource Broker Reagan W. Moore
CIMA and Semantic Interoperability for Networked Instruments and Sensors Donald F. (Rick) McMullen Pervasive Technology Labs at Indiana University
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Data Management: Data Processing Types of Data Processing at USGS There are several ways to classify Data Processing activities at USGS, and here are some.
Use of Policies to Enforce Collection Properties Richard Marciano Reagan Moore University of North Chapel Hill Data Intensive Cyber Environments.
Working Group: Practical Policy Rainer Stotzka, Reagan Moore.
Preservation Data Services Persistent Archive Research Group Reagan W. Moore October 1, 2003.
Data Stewardship Lifecycle A framework for data service professionals Protectors of data.
Working Group: Data Foundations and Terminology (Practical Policy Considerations) Reagan Moore.
Data Grids, Digital Libraries and Persistent Archives: An Integrated Approach to Publishing, Sharing and Archiving Data. Written By: R. Moore, A. Rajasekar,
Research Objects Preserving scientific data and methods Stian Soiland-Reyes, Khalid Belhajjame School of Computer Science, Univ of Manchester myGrid NIHBI.
Policy-Based Data Management integrated Rule Oriented Data System
Metadata in Digital Preservation: Setting the Scene
Technical Issues in Sustainability
Research Data Dr Aoife Coffey, Research Data Coordinator
Presentation transcript:

Working Group: Practical Policy Rainer Stotzka, Reagan Moore

2  Extend the concept of “Data in Context” to “Collection in Context”  A collection provides the context for understanding data  Provenance metadata  Descriptive metadata  Structural metadata  Workflows  Administrative metadata  However, each collection has a driving purpose that represents the consensus of a user community  We observe the the members of the user community evolve, implying re-purposing of the collection.  The evolution redefines the required metadata for the collection context Concept Extensions

3  Local project  Members have detailed tacit knowledge of the semantics, structure, description  Data grid  Data are shared with other institutions, requiring description and access controls  Digital Library  Data are published for the entire discipline, requiring provenance, description, structural information  Reference Collection  Data are published for use by future researchers, requiring knowledge of generation and management of the collection  Reproducible data-driven research  The workflows, input parameters and files, and output results from each execution of a workflow need to be saved  The policies and procedures used to manage an archive also need to be saved  Preservation is “communication with the future”  Preservation requires “validation of communication from the past” Example Collection Evolution

4  Identify the most important policies  Practical implementations for managing research data collections  Provide recommendations for a “starter kit”  Testbeds:  Evaluate standard policies  Test interoperability across WGs Policy: Assertion or assurance that is enforced about a collection or a dataset Practical Policy Working Group Focuses:

5 Policy-Based Data Environments  Purpose  Reason a collection is assembled  Properties  Attributes needed to ensure the purpose  Policies  Controls for enforcing desired properties,  mapped to computer actionable rules  Procedures  Functions that implement the policies  Mapped to computer executable workflows  Persistent state information  Results of applying the procedures  mapped to system metadata  Property verification  Validation that state information conforms to the desired purpose  mapped to periodically executed policies

Collection Purpose Completeness Correctness Consensus Defines Consistency Attribute HasFeature Has Defines Policy Has Property Defines Procedure Control s Updates Client Action Periodic Assessment Criteria Policy Policy Enforcement Point Workflow Invokes Has SubType Isa Function Chains Operation Isa Persistent State Information Persistent State Information Isa Digital Object Updates Has Replication Policy Checksum Policy Quota Policy Data Type Policy Isa Integrity Isa Authenticity Isa Access control Isa GetUserACL SetDataType SetQuota DataObjRepl SysChksumDataObj Isa DATA_ID DATA_REPL_NUM DATA_CHECKSUM Isa HasFeature Concept Graph for Policy-based Management

Policy Categories Collection- based Policies Integrity Data Lifecycle Management Data Staging Federation Description Publication Compliance Data Management Plans Access Control Preservation Provenance Replication Regulatory Management Administrative Assessment