Grid Metadata Management

Slides:



Advertisements
Similar presentations
1 Ontolog OOR Use Case Review Todd Schneider 1 April 2010 (v 1.2)
Advertisements

1 Ontolog Open Ontology Repository Review 19 February 2009.
DC8 Registries Breakout. Goals of the session Discuss and clarify : Requirements for registry Framework for policy Relate issues raised to EOR prototype.
5/30/2012. Provides a method for finding services/data on the Exchange Network – discover data. Supports User Friendly Tools Can automatically collect.
XML DOCUMENTS AND DATABASES
Introduction to Database Management  Department of Computer Science Northern Illinois University January 2001.
Dorian Grid Identity Management and Federation Dialogue Workshop II Edinburgh, Scotland February 9-10, 2006 Stephen Langella Department.
NextGRID & OGSA Data Architectures: Example Scenarios Stephen Davey, NeSC, UK ISSGC06 Summer School, Ischia, Italy 12 th July 2006.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
Page 1 Multidatabase Querying by Context Ramon Lawrence, Ken Barker Multidatabase Querying by Context.
Chapter 4 Relational Databases Copyright © 2012 Pearson Education, Inc. publishing as Prentice Hall 4-1.
Automatic Data Ramon Lawrence University of Manitoba
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation Mike Smorul, Joseph JaJa, Yang Wang, and Fritz McCall.
W3C XML Query Language Working Group Mark Needleman Data Research Associates ZIG Current Awareness Session July 13, 2000.
Secure Systems Research Group - FAU Web Services Standards Presented by Keiko Hashizume.
Introduction to UDDI From: OASIS, Introduction to UDDI: Important Features and Functional Concepts.
Information storage: Introduction of database 10/7/2004 Xiangming Mu.
An Extension to XML Schema for Structured Data Processing Presented by: Jacky Ma Date: 10 April 2002.
LINQ Boot Camp ADO.Net Entity Framework Presenter : Date : Mahesh Moily Nov 26, 2009.
A Metadata Catalog Service for Data Intensive Applications Presented by Chin-Yi Tsai.
WP3 Zetabyte –Exascale Storage Virtualization. How does it fit in? Traditional ProvidersCloud ProvidersXXX Providers Providing: Work/Archive Storage,
Chapter 1 : Introduction §Purpose of Database Systems §View of Data §Data Models §Data Definition Language §Data Manipulation Language §Transaction Management.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System on gLite middleware Vincent.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
©Silberschatz, Korth and Sudarshan1.1Database System Concepts Chapter 1: Introduction Purpose of Database Systems View of Data Data Models Data Definition.
Web Services Standards. Introduction A web service is a type of component that is available on the web and can be incorporated in applications or used.
Introduce Grid Service Authoring Toolkit Shannon Hastings, Scott Oster, Stephen Langella, David Ervin Ohio State University Software Research Institute.
Database Systems DBMS Environment Data Abstraction.
OAI Overview DLESE OAI Workshop April 29-30, 2002 John Weatherley
CSEN 5314 Quiz 1. A data model is a collection of concepts that can be used to describe the ___________ of a database. a. structure b. extension c. state.
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA gLite Information System Pedro Rausch IF.
1 Registry Services Overview J. Steven Hughes (Deputy Chair) Principal Computer Scientist NASA/JPL 17 December 2015.
GEM METADATA DEVELOPMENT Xiaoping Wang, Macrosearch Allen Macklin, PMEL and Bernard Megrey, AFSC.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America gLite Information System Claudio Cherubino.
Database Environment Chapter 2. The Three-Level ANSI-SPARC Architecture External Level Conceptual Level Internal Level Physical Data.
What problems are we trying to solve? Hannes Tschofenig.
Introduction: Databases and Database Systems Lecture # 1 June 19,2012 National University of Computer and Emerging Sciences.
E-science grid facility for Europe and Latin America Updates on Information System Annamaria Muoio - INFN Tutorials for trainers 01/07/2008.
Online Information and Education Conference 2004, Bangkok Dr. Britta Woldering, German National Library Metadata development in The European Library.
Enabling Grids for E-sciencE Agreement-based Workload and Resource Management Tiziana Ferrari, Elisabetta Ronchieri Mar 30-31, 2006.
System Administration(SAD622S) Name of Presenter: Shadreck Chitauro Lecturer 18 July 2016 Faculty of Computing and Informatics.
Introduction to DBMS Purpose of Database Systems View of Data
Databases and DBMSs Todd S. Bacastow January 2005.
Database Systems: Design, Implementation, and Management Tenth Edition
Metadata Issues in Long-term Management of Data and Metadata
Issues need harmonization
Database Management.
Chapter 2 Database Environment.
IMPLEMENTING NAME RESOLUTION USING DNS
Middleware independent Information Service
AMGA Web Interface Salvatore Scifo INFN sez. Catania
Introduction What is a Database?.
Chapter 4 Relational Databases
Chapter 2 Database Environment.
Chapter 2 Database Environment Pearson Education © 2009.
The ANSI/SPARC Architecture aka the 3 Level Architecture
Chapter 2 Database Environment.
Data, Databases, and DBMSs
Database solutions Database environment Marzena Nowakowska Faculty of Management and Computer Modelling Kielce University of Technology rooms: 3.21 C,
AMGA Web Interface Vincenzo Milazzo
Data Model.
Introduction to DBMS Purpose of Database Systems View of Data
LOD reference architecture
Chapter 2 Database Environment Pearson Education © 2014.
The ANSI/SPARC Architecture of a Database Environment
Decentralised Middleware and Workflow Enactment
Chapter 2 Database Environment Pearson Education © 2009.
Database SQL.
Chapter 2 Database Environment Pearson Education © 2009.
Information Services Claudio Cherubino INFN Catania Bologna
Presentation transcript:

Grid Metadata Management Shannon Hastings (hastings@bmi.osu.edu) Stephen Langella (langella@bmi.osu.edu)

Metadata? A few clarifying statements. Metadata Definition = “A description of the structure and syntax of metadata” (ie XML schema) Metadata = “Data that describes data. In this context: an instance of a Metadata Definition” (ie XML document) Metadata Definition is to Metadata as XML Schema is to an XML Document. Metadata to one application/user is data to another.

Metadata in the Grid Used by the grid for definition of services, protocols, workflow, security, data access, data integration, data, ……. Used as an abstraction between two institutions “data”. Provides a “standard” for describing data Promotes inter-institutional data sharing Can be used to translate one data type to another

Metadata on the Grid The need for a “global schema” Promote creation and evolution of standard descriptions of metadata. For communications between multiple institution they must agree on a common structure or a mapping between structures. Allow for sharing and discovery of metadata.

Metadata on the Grid Global Schema Issues Changing schemas Schema’s disappear Conflicting schemas Discovering schemas Multiple definitions of similar schemas for different communities User/Organization defined entities

Global Schema Management Schema Management Service Manages the Global Schema Handles presented issues Provides submission and discovery protocol Scalable Replication Caching DNS like architecture?

Global Schema Management Schema Management Service Inserts, Versions, and Deletes Schemas Schema Discovery Security Hierarchical service instances Each has an authority (excluding root) Each is the authority of a namespace

Global Schema Management User submits a version of a schema to the authoritative SMS of that namespace.

Global Schema Management User publishes schema to the authoritative SMS of that namespace. The submitted schema has an element reference to another schema published in the same SMS.

Global Schema Management User publishes schema to the authoritative SMS of that namespace. The submitted schema has an element reference to another schema published in another namespace in it’s particular authoritative SMS

Global Schema Management User queries an SMS for a particular schema published in another SMS. The query will be propagated up the SMS hierarchy until an SMS is able to or know where the query can be responded to. The response will happen in the same way. It will propagate up the SMS hierarchy until a SMS node knows where to deliver it.

Metadata Gateway Metadata Gateway Store metadata Update metadata Retrieve metadata Delete metadata Query metadata Validate metadata Provides Security and tight access control Control which metadata is acceptable by an institution. Virtual Operations?

Other Metadata Services? Namespace Management For schema management services For metadata databases Security Service Metadata Definition Metadata Mapping Service How can I map data types defined in one schema to another.