The RPID Testbed Rob Quick Manager – High Throughput Computing

Slides:



Advertisements
Similar presentations
National Library of New Zealand Dave Thompson Resource Development Analyst Digital Initiatives Unit.
Advertisements

Handle System: DOI Technical Infrastructure Corporation for National Research Initiatives Larry Lannom December 10, 1997.
Corporation For National Research Initiatives DOIs and the Handle System 5 August 1998 Larry Lannom CNRI.
Corporation For National Research Initiatives DOIs and the Handle System 7 May 1998 Larry Lannom CNRI.
A Unified Approach to Combat Counterfeiting: Use of the Digital Object Architecture and ITU-T Recommendation X.1255 Robert E. Kahn President & CEO CNRI,
A Very Brief Introduction to iRODS
Jose Jimenez Director. International Programmes Telefónica Digital Future INTERNET – SMART CITIES Advancing the global competitiveness of the EU economy.
Handle System Overview Larry Lannom 18 May 2004 Corporation for National Research Initiatives Copyright©
A Framework for Distributed Preservation Workflows Rainer Schmidt AIT Austrian Institute of Technology iPres 2009, Oct. 5, San.
CORDRA Philip V.W. Dodds March The “Problem Space” The SCORM framework specifies how to develop and deploy content objects that can be shared and.
Tobias Weigel (DKRZ) Tobias Weigel Deutsches Klimarechenzentrum (DKRZ) Persistent Identifiers Solving a number of problems through a simplistic mechanism.
Resolving Unique and Persistent Identifiers for Digital Objects Why Worry About Identifiers? Individuals and organizations, including governments and businesses,
Localized Linking Prototype CNI April 10, 2001 Dale Flecker, Larry Lannom, Rick Luce, Bill Mischo, Ed Pentz.
Digital Object Architecture
Microsoft Academic Search Search | Explore | Discover Alex D. Wade Director - Scholarly Communication.
A semi autonomic infrastructure to manage non functional properties of a service Pierre de Leusse Panos Periorellis Paul Watson Theo Dimitrakos UK e-Science.
Attaching Rights to Content Larry Lannom Corporation for National Research Initiatives Copyright ©
Mirroring an OAI archive with an I2-DSI channel Ryan Richardson Edward A. Fox Digital Library Research Laboratory Virginia Tech May 7 th, 2002.
TWC Adoption of RDA DTR and PID in Deep Carbon Observatory Data Portal Stephan Zednik, Xiaogang Ma, John Erickson, Patrick West, Peter Fox, & DCO-Data.
Alternative Architecture for Information in Digital Libraries Onno W. Purbo
Deepcarbon.net Xiaogang Ma, Patrick West, John Erickson, Stephan Zednik, Yu Chen, Han Wang, Hao Zhong, Peter Fox Tetherless World Constellation Rensselaer.
Authorization GGF-6 Grid Authorization Concepts Proposed work item of Authorization WG Chicago, IL - Oct 15 th 2002 Leon Gommans Advanced Internet.
Persistent Identifiers (PIDs) & Digital Objects (DOs) Christine Staiger & Robert Verkerk SURFsara.
PARALLEL AND DISTRIBUTED PROGRAMMING MODELS U. Jhashuva 1 Asst. Prof Dept. of CSE om.
TWC Adoption* of RDA DTR and PIT in the Deep Carbon Observatory Data Portal Xiaogang Ma, John Erickson, Patrick West, Stephan Zednik, Peter Fox, & the.
Preservation e-Infrastructure IG Description: help ensure preservation of needed data succeeds Goals: foster worldwide collaboration; ensure consistency.
Data Fabric IG From Testing to Recommendations Beth Plale.
Digital Object Architecture Tutorial
Data Grids, Digital Libraries and Persistent Archives: An Integrated Approach to Publishing, Sharing and Archiving Data. Written By: R. Moore, A. Rajasekar,
Bringing visibility to food security data results: harvests of PRAGMA and RDA Quan (Gabriel) Zhou, Venice Juanillas Ramil Mauleon, Jason Haga, Inna Kouper,
1 This slide indicated the continuous cycle of creating raw data or derived data based on collections of existing data. Identify components that could.
Intentions and Goals Comparison of core documents from DFIG and Publishing Workflow IG show that there is much overlap despite different starting points.
Microsoft Academic Search Search | Explore | Discover
RDA 9th Plenary Breakout 3, 5 April :00-17:30
RDA Europe: Views about PID Systems
RDA to Deliver Why? What? When? How?.
RDA Data Fabric (DF) Interest Group Peter Wittenburg & Gary Berg-Cross
Power of PID kernel information
WG Research Data Collections RDA P10 Montréal – September 2017
Data Ingestion in ENES and collaboration with RDA
Data Type Registries Breakout
Corporation for National Research Initiatives
Xiaogang Ma, John Erickson, Patrick West, Stephan Zednik, Peter Fox,
Module 8: Securing Network Traffic by Using IPSec and Certificates
PID centric fabric constructed piece by piece
Putting All The Pieces Together: Developing a Cyberinfrastructure at the Georgia State University Library Tim Daniels, Learning Commons Coordinator Doug.
CS 501: Software Engineering Fall 1999
Data Type Registries (DTR)
Agenda Welcome and overview (Peter)
C2CAMP (A Working Title)
Persistent identifiers in VI-SEEM
Wsdl.
Chapter 4 Functions Objectives
EUDAT B2FIND A Cross-Discipline Metadata Service and Discovery Portal
An ecosystem of contributions
Federated Digital Rights Management
Brief WG/IG reporting Tobias Weigel on behalf of co-chairs
WG Research Data Collections Draft outputs of a RDA bottom-up effort P9 - April 2017 Co-chairs: Bridget Almas, Frederik Baumgardt, Tobias Weigel, Thomas.
Using the RDA Collections API to Shape Humanities Data
An EUDAT-based FAIR Data Approach for Data Interoperability
Datatypes Characterizing data
Communications & Computer Networks Resource Notes - Introduction
Agenda (AM) 9:30-10:15 Introduction to RDA
Module 8: Securing Network Traffic by Using IPSec and Certificates
JISC and SOA A view Robert Sherratt.
Bird of Feather Session
Digital Object Management for ENES: Challenges and Opportunities
RPID: An Overview Rob Quick (Beth Plale) PI
WG PID Kernel Information RDA P11 Berlin – March 2018
Leveraging PIDs for object management in data infrastructures RDA UK Node Workshop, July Tobias Weigel (DKRZ)
Presentation transcript:

The RPID Testbed Rob Quick Manager – High Throughput Computing Research Technologies Indiana University Some slides provided by Beth Plale RDA Plenary Montreal, Canada Sept 2017

Our vision Starts with data network based on Digital Object Architecture (DOA), a distributed architecture of services spread worldwide that together identify and resolve digital objects DOA first espoused by Internet founder Robert Khan in the mid’80’s. DOA is a network of Handle servers at its core Indiana University

The Digital Object Architecture serves as base infrastructure only The Digital Object Architecture serves as base infrastructure only. DOA is silent on issues of modeling data objects themselves: their content, their relationship to their own metadata, and relationship between data objects For object modeling we turn to FAIR principles and PID Kernel Information

(e.g., PID to Profile, URL to target) Handle resolution in a Digital Object Architecture Client Handle System Q: prefix authority PIT API SDK Scale: [80…100] GHS Global Handle Servers Local Handle Service IP Q: local handle Scale: [1000…5000] LHS Local Handle Service Handle information Stores PID kernel information (e.g., PID to Profile, URL to target) Q: DTR with Profile PID Data Type Registry Service Scale: [1..10] Filter-ed PIDS DTR Profile Definition Stores type definitions for kernel information Trusted PIDs

What should go into the PID Kernel Information What should go into the PID Kernel Information? PID  Kernel Information is a small amount of information stored at resolver (Local Handle Server) in PID record of a PID Inspiration: take FAIR principles as guide: how far can PID Kernel Information aid in implementing FAIR?

Further imagine an Internet-scale data client that is handed a list of a 100,000,000 PIDs. How does client quickly sift through list to find research data objects? Further suppose client is able to winnow list down to just research data objects, how does it then quickly discard fakes? plale@indiana.edu

Global Handle Registry PID Kernel Information Use case: Client filters list of millions of PIDs to identify research data and makes simple determination of trust Client Handle System Q: prefix authority Global Handle Registry Local Handle Service IP Q: local handle Stores PID kernel information Local Handle Service [1000…5000] Handle information Q: DTR with Profile PID Data Type Registry Service Filter-ed PIDS DTR Profile Definition Stores type definitions for kernel information Trusted research PIDs

Client working with PID Kernel Information looks at each PID in list, accepts those that have: -- Kernel Information profile stored in Data Type Registry (DTR), -- That profile is associated with RDA (in some unspecified manner) -- PID Kernel Information holds tiny amount of data provenance from which basic sense of trust is derived

PID Kernel Information Summary Exploration driven by identifying and evaluating minimal information that can go into Kernel Information that can help make Data Objects FAIR and less dependent on the repository system to enforce FAIRness? Long term goal: Smart data objects Kernel information has potential to spawn new ecosystem of data services for smart data objects

RPID testbed Suite of software services for use by community Data type registry (RDA) PIT API (RDA) Handle service Exploratory services PID Kernel Information Mapping CTS URNs to handles Packaging for use by others Help and advice User advisory group Indiana University

The RPID testbed is open for research, education, non-profit, or pre-competitive use. Ideas are being put into action through a US NSF funded project called Robust PID (RPID) Testbed Project partners include Beth Plale, Rob Quick, Robert McDonald, Yu Lao Indiana University Bridget Almas, Tufts University Larry Lannom, CNRI The opinions expressed here are those of author alone and do not represent the views of the US National Science Foundation