An information and monitoring system for static and dynamic information about grid resources, applications, networks … RDBMS Servlet aware of API during.

Slides:



Advertisements
Similar presentations
21 Sep 2005LCG's R-GMA Applications R-GMA and LCG Steve Fisher & Antony Wilson.
Advertisements

WP3 WP3 17/9/2002 Steve Fisher / RAL. WP3 Steve Fisher 17/9/2002WP32 Summary Quality Current status 1.2 R-GMA in release 2.0 Recent Requirements Work.
Steve Fisher/RAL - 12/6/2002R-GMA and WP71 R-GMA Use the GMA from GGF A relational implementation Applied to both information and monitoring Creates impression.
Grid Application Builders Teach In31/01/02Antony Wilson Information & Monitoring Services WP3.
Web Service Ahmed Gamal Ahmed Nile University Bioinformatics Group
This product includes material developed by the Globus Project ( Introduction to Grid Services and GT3.
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
Computer Monitoring System for EE Faculty By Yaroslav Ross And Denis Zakrevsky Supervisor: Viktor Kulikov.
CrossGrid WP3 Task 3.3 Grid Monitoring Trinity College Dublin (TCD, AC14 - CR11) Brian Coghlan, Stuart Kenny CYFRONET Academic Computer Centre, Krakow.
NextGRID & OGSA Data Architectures: Example Scenarios Stephen Davey, NeSC, UK ISSGC06 Summer School, Ischia, Italy 12 th July 2006.
WP3 R-GMA Revisited 23/7/2002 Werner Nutt / Heriot-Watt University.
CS CS 5150 Software Engineering Lecture 13 System Architecture and Design 1.
Canonical Producer CP API User Code CP Servlet Files CreateTable, Port, Protocol, Security, SQL Support, Multiple Query Support Security Insert Query Port.
WP3 R-GMA & OGSA 23/7/2002 James Magowan / IBM. WP3 James Magowan - 23/7/2002R-GMA & OGSA2 Contributors Brian CoghlanTCD Andy CookeHeriot-Watt Ari DattaQMUL.
OGSA : Open Grid Services Architecture Ramya Rajagopalan
CVSQL 2 The Design. System Overview System Components CVSQL Server –Three network interfaces –Modular data source provider framework –Decoupled SQL parsing.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Introduction to R-GMA: Relational Grid Monitoring Architecture.
The EU DataGrid – Information and Monitoring Services The European DataGrid Project Team
WP3 RGMA Deployment Laurence Field / RAL Steve Fisher / RAL.
Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.
Introduction on R-GMA Shi Jingyan Computing Center IHEP.
Computer and Automation Research Institute Hungarian Academy of Sciences Presentation and Analysis of Grid Performance Data Norbert Podhorszki and Peter.
DataGrid is a project funded by the European Union CHEP March 2003 R-GMA 1 R-GMA: First results after deployment Steve Fisher (EDG - WP3)
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Information System (IS) Valeria Ardizzone.
Lecturer: Prof. Piero Fraternali, Teaching Assistant: Alessandro Bozzon, Advanced Web Technologies: Struts–
Application code Registry 1 Alignment of R-GMA with developments in the Open Grid Services Architecture (OGSA) is advancing. The existing Servlets and.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
GLite Information System(s) Antonio Juan Rubio Montero CIEMAT 10 th EELA Tutorial. Madrid, May 7 th -11 th,2007.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks R-GMA Now With Added Authorization Steve.
Registry Replication Registry calls are forwarded by a registry Service to a single registry instance (i.e. replica) per VDB. If a replica cannot be contacted.
WP3 Information and Monitoring Steve Fisher / RAL 23/9/2003.
The Replica Location Service The Globus Project™ And The DataGrid Project Copyright (c) 2002 University of Chicago and The University of Southern California.
E-infrastructure shared between Europe and Latin America 12th EELA Tutorial for Users and System Administrators gLite Information System.
WP3 R-GMA: Likely status New Years Eve Steve Fisher / RAL 24/2/2003.
CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.
Performance Measurement Points Sockets, plain text and grid services Paul Mealor.
A university for the world real R © 2009, Chapter 9 The Runtime Environment Michael Adams.
Prof S.Ramachandram Dept of CSE,UCE Osmania University
WP3 RGMA Deployment Laurence Field / RAL Steve Fisher / RAL.
WP3 R-GMA: A Relational Grid information and monitoring system Steve Fisher / RAL 13/12/2002.
INFSO-RI Enabling Grids for E-sciencE
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA gLite Information System Pedro Rausch IF.
WP3 Werner Nutt (Heriot-Watt University) R-GMA – DataGrid’s Monitoring System 1/7/2003.
R-GMA – an Update A reminder of R-GMA The need for a mediator Work with WP7 Release 1.2 and beyond Some Implications of OGSA.
 CMS data challenges. The nature of the problem.  What is GMA ?  And what is R-GMA ?  Performance test description  Performance test results  Conclusions.
WP3 The status of the EU DataGrid's R-GMA system Steve Fisher / RAL 24/4/2003.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America gLite Information System Claudio Cherubino.
E-infrastructure shared between Europe and Latin America gLite Information System(s) Manuel Rubio del Solar CETA-CIEMAT EELA Tutorial, Mérida,
The impact of R-GMA (upon WP1 and WP4). EDG (Paris) 6 Mar James MagowanImpact of R-GMA Grid Monitoring Architecture (GMA) We use it not only for.
INFSO-RI Enabling Grids for E-sciencE Information System Valeria Ardizzone INFN EGEE NA4 Generic Applications Meeting Catania,
EGEE is a project funded by the European Union under contract IST Information and Monitoring Services within a Grid R-GMA (Relational Grid.
WP3 Implementing R-GMA grid services in GT3 Abdeslem Djaoui & WP3 Grid Services Task Force 7 th EU Datagrid meeting 26/09/2003
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
INFSO-RI Enabling Grids for E-sciencE R-GMA Gergely Sipos and Péter Kacsuk MTA SZTAKI Credit to Valeria Ardizzone.
INFSO-RI Enabling Grids for E-sciencE gLite Information System: R-GMA Tony Calanducci INFN Catania gLite tutorial at the EGEE User.
CERN 21 January 2005Piotr Nyczyk, CERN1 R-GMA Basics and key concepts Monitoring framework for computing Grids – developed by EGEE-JRA1-UK, currently used.
DEVELOPING WEB SERVICES WITH JAVA DESIGN WEB SERVICE ENDPOINT.
XML 1. Chapter 8 © 2013 Pearson Education, Inc. Publishing as Prentice Hall SAMPLE XML SCHEMA (XSD) 2 Schema is a record definition, analogous to the.
Relational Grid Monitoring Architecture (R-GMA)
Grid Event Management Using R-GMA Monitoring Framework
Network Infrastructure Services Supporting WAP Clients
gLite Information System(s)
The EU DataGrid – Information and Monitoring Services
Practicals on R-GMA Valeria Ardizzone INFN
OGSA Data Architecture Scenarios
Programming Models for Distributed Application
Data, Databases, and DBMSs
gLite Information System(s)
Understanding and Designing with EJB
RELATIONAL GRID MONITORING ARCHITECHTURE
Presentation transcript:

An information and monitoring system for static and dynamic information about grid resources, applications, networks … RDBMS Servlet aware of API during terminationInterval durationExistence of service instances in Registry up to terminationTime Work on an OGSA-compliant implementation of R-GMA is in progress. Producer and Consumer servlets will be replaced by Grid service factories which will then create the Producer and Consumer instances. Lifecycle management will be handled using OGSA mechanisms. The registry will include a HandleResolver. Consumers will use OGSA notification in order to keep track of the set of Producers that are of interest. Initially SQL will be used as Service Data Element query language, but XML based query languages (XPath, XQuery) can be adopted if needed. The first stages of this process are currently implemented and involved isolating logic from the servlet infrastructures, separating the core instance logic from the creation and tracking of these instances. Actions outstanding: Interoperability with GT3. Our Registry compatibility with OGSA registries. Replication of Registry/Schema services within OGSA. Additional Query Languages e.g. XQuery, XPath Use of Notification Mechanisms for information flow. In the GMA of the Global Grid Forum(GGF) Producers register themselves with the Registry and describe the type and structure of information they want to make available to the Grid. Consumers can query the Registry to find out what type of information is available and locate relevant Producers. The Consumer can then contact the Producers directly to obtain the data. By specifying the Consumer/Producer protocol and the interfaces to the Registry one can build inter-operable services. The Grid environment needs to be aware of the existence of Producer and Consumer instances. The service result in the creation of a service instance at the servlet side. This state needs to be tidied up if the service disappears. Both Producers and Consumers are also registered within the Registry database. There are two categories of state management in our system, a servlet's awareness of an services communication with a service instance and the registering of the existence of service instances within the grid. Lifecycle management is modelled around the OGSA specification. The service has a termination interval associated with it. The servlet counts down a proportion of the termination interval and when it hears from the service within that time interval, it resets the termination time of the service instance to the current time + termination interval. If the servlet counts down the full termination interval it will remove all traces of the service instance and inform the registry to tidy itself up. In order to allow for network delays and reduce network load, the servlet resets termination times with the registry before the service termination interval expires, but not after every time the service contacts the service instance. Producer1 Info mastered by Registry1 Copy of info from Registry2 Registry2 Info mastered by Registry2 Copy of info from Registry1 Producer2 Registry1 A peer-to-peer policy for registry replication is adopted within R-GMA. Each registry is responsible for replicating its local data with other registries. Registry1 ensures Registry2 has a copy of all information it masters and similarly Registry2 ensures Registry1 has a copy of all information it masters. A checksum is sent between registries to validate replicated data. A failed checksum forces all replication data to be resent. Each registry maintains a list of the locations of other registries. Data that has been replicated is flagged to prevent duplication or re-replication. Deleted data is not sent for replication, lifetime management takes care of this. Any columns relating to time stamps are not replicated. Producer registration Registry Servlet By providing a mapping between LDAP ObjectClasses and relational tables it is possible to publish from MDS information provider scripts to R-GMA and publish from R-GMA to an LDAP server. LDAP multivalue attributes are mapped onto separate tables. Registry API R-GMA is a relational implementation of the Grid Monitoring Architecture (GMA). Producers: A Producer is instantiated with the description of the information it has to offer specified by an SQL CREATE TABLE statement and a WHERE clause expressing a predicate that is true for the table. An instance of the producer is then created within the corresponding servlet and registered with the Registry/Schema. The Registry holds a table identifier for each table and a representation of the WHERE clause. The detailed information about the tables - what columns they have and of what type - is held in the Schema. To publish data, a method is invoked which takes the form of a normal SQL INSERT. Consumers: A Consumer handles a single query, expressed as an SQL SELECT statement. The table identifier and the WHERE clause of the Consumer query is stored in the Registry. Example producer ‘CPULoad' CountrySiteFacilityLoadTimestamp UKRALCDF UKRALATLAS UKGLACDF UKGLAALICE CHCERNALICE CHCERNCDF Example consumer: SELECT * FROM cpuLoad WHERE country = ’UK’ AND site = ’RAL’ Producer Consumer Registry register lookup transfer data Command Data Client side Hidden components Sensor RDBMS Each type of Producer or Consumer API communicates with a corresponding servlet. A single servlet can serve many API instances. This avoids needing a large number of servers but offers great flexibility as we can always add more servers if necessary to balance the load. Access to servlets is via HTTP GET/POST using a thin client API. The response from the servlets is in the form of an XML string which conforms to an XML schema definition and contains either a custom ResultSet or an exception. Application code DataBaseProducer API LatestProducer API Consumer API Schema API Registry API Registry Servlet DBProducer Servlet Schema Servlet Registry API LatestProducer Servlet Consumer Servlet Sensor Producer API Producer Factory Consumer Instance Schema Registry Producer Instance Consumer Factory Sensor Producer API Application Code Consumer API Producer Servlet Producer instance Sensor Code Producer API Application Code Consumer API Producer Servlet Registry API Registry Servlet Schema API Schema Servlet Consumer Servlet LDAP InfoProvider RDBMS LDAP Producer API R-GMA Archiver API Consumer API GOUT GIN Registry API