INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org www.glite.org Information and Monitoring Status and Plans Plzeň, 10 July 2006 Steve Fisher/RAL.

Slides:



Advertisements
Similar presentations
21 Sep 2005LCG's R-GMA Applications R-GMA and LCG Steve Fisher & Antony Wilson.
Advertisements

INFSO-RI Enabling Grids for E-sciencE Information and Monitoring Status and Plans GridPP18, Glasgow, Mar 2007.
INFSO-RI Enabling Grids for E-sciencE Information and Monitoring Status and Plans GridPP16, QMUL, 29 Jun 2006 Steve.
EGEE is a project funded by the European Union under contract IST R-GMA: Status and Plans Antony Wilson / RAL GridPP 12 - Brunel
Principles of Personalisation of Service Discovery Electronics and Computer Science, University of Southampton myGrid UK e-Science Project Juri Papay,
Adding scalability to legacy PHP web applications Overview Mario A. Valdez-Ramirez.
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Regional Operations Dashboard Workplan Cyril.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Introduction to R-GMA: Relational Grid Monitoring Architecture.
EGEE-II INFSO-RI Enabling Grids for E-sciencE PSNC work status Gerard Frankowski, Rafał Lichwała Poznań Supercomputing.
ES Metadata Management Enabling Grids for E-sciencE ES metadata OGSA-DAI NA4 GA Meeting, D. Weissenbach, IPSL, France.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Interoperability Shibboleth - gLite Christoph.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks General relationships with EGEE JRA1 SA3.
The huge amount of resources available in the Grids, and the necessity to have the most up-to-date experimental software deployed in all the sites within.
Advanced Computer Networks Topic 2: Characterization of Distributed Systems.
INFSO-RI Enabling Grids for E-sciencE The gLite Software Development Process Alberto Di Meglio EGEE – JRA1 CERN.
Enabling Grids for E-sciencE SA1 EGEE-II INFSO-RI The Pre-Production Service in WLCG/EGEE A. Retico, N. Thackray CERN – Geneva, Switzerland PPS.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GSVG issues handling Dr Linda Cornwall CCLRC.
EGEE is a project funded by the European Union under contract IST Outstanding design issues Stephen Hicks 23/06/04
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks R-GMA Now With Added Authorization Steve.
Enabling Grids for E-sciencE EGEE-III INFSO-RI I. AMGA Overview What is AMGA Metadata Catalogue of EGEE’s gLite 3.1 Middleware Main Feature of.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GStat 2.0 Joanna Huang (ASGC) Laurence Field.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks JRA1 summary Claudio Grandi EGEE-II JRA1.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Kelsey RAL/STFC,
WP3 Information and Monitoring Steve Fisher / RAL 23/9/2003.
® IBM Software Group © 2007 IBM Corporation Best Practices for Session Management
INFSO-RI Enabling Grids for E-sciencE Strategy for gLite multi-platform support Author:Eamonn Kenny Meeting:SA3 All Hands Meeting.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks State of Interoperability Laurence Field.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Build Programme and Multi-Platform.
GLite – An Outsider’s View Stephen Burke RAL. January 31 st 2005gLite overview Introduction A personal view of the current situation –Asked to be provocative!
EGEE is a project funded by the European Union under contract IST R-GMA: Production Services for Information and Monitoring in the Grid John.
EGEE is a project funded by the European Union under contract IST Tools survey status, first experiences with the prototype Diana Bosio EGEE.
Module 4: Configuring Active Directory Sites and Replication.
Grid Deployment Enabling Grids for E-sciencE BDII 2171 LDAP 2172 LDAP 2173 LDAP 2170 Port Fwd Update DB & Modify DB 2170 Port.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MSG - A messaging system for efficient and.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Using GStat 2.0 for Information Validation.
INFSO-RI Enabling Grids for E-sciencE Building a robust distributed system: some lessons from R-GMA WLCG Service Reliability.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
WP3 Information and Monitoring Rob Byrom / WP3
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Update on Network Performance Monitoring.
INFSO-RI Enabling Grids for E-sciencE gLite Middleware Status Frédéric Hemmer, JRA1 Manager, CERN On behalf of JRA1.
INFSO-RI Enabling Grids for E-sciencE The gLite Software Development Process Alberto Di Meglio EGEE – JRA1 CERN.
INFSO-RI Enabling Grids for E-sciencE /10/20054th EGEE Conference - Pisa1 gLite Configuration and Deployment Models JRA1 Integration.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Communication tools between Grid Virtual.
INFSO-RI Enabling Grids for E-sciencE Information System Valeria Ardizzone INFN EGEE NA4 Generic Applications Meeting Catania,
EGEE is a project funded by the European Union under contract IST Information and Monitoring Services within a Grid R-GMA (Relational Grid.
INFSO-RI Enabling Grids for E-sciencE gLite Certification and Deployment Process Markus Schulz, SA1, CERN EGEE 1 st EU Review 9-11/02/2005.
Configuration & Management for Joachim Flammer Integration Team EGEE is a project funded by the European Union under contract IST JRA1 all-hands-meeting,
INFSO-RI Enabling Grids for E-sciencE R-GMA Gergely Sipos and Péter Kacsuk MTA SZTAKI Credit to Valeria Ardizzone.
Site Services and Policies Summary Dirk Düllmann, CERN IT More details at
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
INFSO-RI Enabling Grids for E-sciencE gLite Information System: R-GMA Tony Calanducci INFN Catania gLite tutorial at the EGEE User.
INFSO-RI Enabling Grids for E-sciencE Operations Parallel Session Summary Markus Schulz CERN IT/GD Joint OSG and EGEE Operations.
EGEE is a project funded by the European Union under contract IST The UK Cluster Steve Fisher / RAL JRA1 meeting at Cork, 19/ April
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ROC model assessment AP ROC ShuTing Liao.
WP3 Relational Work Progress Report 11/5/2001 Steve Fisher / RAL.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Dashboard for Operations Cyril L’Orphelin.
INFSO-RI Enabling Grids for E-sciencE Information and Monitoring Status and Plans GridPP-DB, IC London, 12 July, 2007.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CYFRONET site report Marcin Radecki CYFRONET.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarksEGEE-III INFSO-RI MPI on the grid:
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Towards an Information System Product Team.
INFSO-RI Enabling Grids for E-sciencE Padova site report Massimo Sgaravatto On behalf of the JRA1 IT-CZ Padova group.
INFSO-RI Enabling Grids for E-sciencE GOCDB2 Matt Thorpe / Philippa Strange RAL, UK.
EGEE is a project funded by the European Union under contract IST Datamat Status Report F. Pacini Datamat S.p.a. Milan, IT-CZ JRA1 meeting,
INFSOM-RI WP3: WP3: Software configuration tools and methodologies Status Report ETICS All-Hands – 23 May 2007 E. Ronchieri.
R-GMA as an example of a generic framework for information exchange
Presentation transcript:

INFSO-RI Enabling Grids for E-sciencE Information and Monitoring Status and Plans Plzeň, 10 July 2006 Steve Fisher/RAL on behalf of JRA1-UK

Enabling Grids for E-sciencE INFSO-RI Steve Fisher/RAL 2 R-GMA R-GMA is now working well –with experienced users Released a bad RPM recently –It had passed certification and time on PPS  Shows that JRA1-UK testing is still inadequate  Should have failed in certification on one of the tests we gave to SA3  Should have shown memory leak in fairly short time on PPS –Had to produce new RPMs with old code –Proper fix now in certification  Has shown up problem with tagging/building Used in various applications

Enabling Grids for E-sciencE INFSO-RI Steve Fisher/RAL 3 SD Status In production Developed by Data Management and JRA1-UK within EGEE-I Only BDII plug-in currently configured Many services not correctly advertising Not enough services using the API

Enabling Grids for E-sciencE INFSO-RI Steve Fisher/RAL 4 Work-plan Two requirements directly related to the JRA1-UK work. –Security:  #101 - make use of VOMS groups and roles –Information System:  #111 - to provide fast and reliable access to service end points. Work-plan approved a few weeks ago –Subject to a small change

Enabling Grids for E-sciencE INFSO-RI Steve Fisher/RAL 5 R-GMA Plans Design has some limitations which are hard to work around. Currently working on a new design which includes –Authz –Multiple VDB (name spaces) –Registry and schema replication –Support for Oracle and other RDBMS. –Easy to wrap as web service

Enabling Grids for E-sciencE INFSO-RI Steve Fisher/RAL 6 First release of new design No new functionality in first release Significant changes include: –The registry no longer sends out notifications.  Should increase reliability  Registry replication much simpler –Only one socket for streaming from one machine to another –Regular handling of remote invocation (time-outs etc) –Database independence –Managed tuple stores - essential to support authz –Multiple VDB support but no cross VDB queries Compatibility with previous releases –APIs must be able to work with old and new services –Services must be able to interoperate

Enabling Grids for E-sciencE INFSO-RI Steve Fisher/RAL 7 Subsequent releases Will provide in this sequence: 1.Queries over multiple VDBs –Almost standard SQL –Extension for Unions 2.Authz by VDB –This will make use of certificate attributes (VOMS groups/roles) –Database engine is used to implement parameterised views 3.Registry replication –Much easier now that registry is passive 4.Schema replication –Still to be designed – may not be easy 5.Oracle support –DB independence part of new design

Enabling Grids for E-sciencE INFSO-RI Steve Fisher/RAL 8 Service Discovery (SD) Plans We will work on more responsive SD by invoking the plug-ins in parallel. –The fastest plug-in wins We are asked to support use of scripts calling utilities which use SD –Should utility do caching or the SD API?  SD solution has to be general so heavier  How many utilities to consider? “Configuration-free” SD being developed –Useful as a bootstrap mechanism  it can locate the R-GMA server on the local subnet.

Enabling Grids for E-sciencE INFSO-RI Steve Fisher/RAL 9 Time scales Hard to estimate: –Considerable effort can be "lost" in support. –JRA1-UK has a temporary but critical shortage of manpower.  4 resignations from the team in 3 months  Interviewing this week We had hoped to achieve by the end of this year: –queries over multiple VDBs and authz (using VOMS attributes) by VDB –R-GMA clients with the option of automatic configuration –SD caching or persuade utility providers to do it –Parallel invocation of SD plugins

Enabling Grids for E-sciencE INFSO-RI Steve Fisher/RAL 10 Mailing lists 3 lists: –R-GMA-ANNOUNCE  Low volume for R-GMA announcements to users  Moderated  Replies go to JRA1-UK list –JRA1-UK  “Public” JRA1-UK list –R-GMA-SA1  Similar to JRA1-UK but includes SA1 people  Created for discussing SA1 applications – e.g. GridView To subscribe to any of these lists: –

Enabling Grids for E-sciencE INFSO-RI Steve Fisher/RAL 11 QAG and Quality We have partner metrics to worry about in future –They were missed off the template this Q I have produced the JRA1 Q And Measurement Plan –Strongly based on the EGEE-I doc from Alberto di M.  Removed SA3 material  Tried to make it realistic –Contents:  Standards Programming guidelines Test guidelines  Processes Adherence to the EGEE developers guide Software Quality Reviews Code reviews and walk-throughs Documentation reviews Metric Monitoring  Metrics  Tools

Enabling Grids for E-sciencE INFSO-RI Steve Fisher/RAL 12 INFOD-WG of OGF (was GGF) Base specification –With the GGF editor  Should go to public comment in about a week –Packaged as an extension to WSN Use Case document still needs work to make it match –No intention to publish it however 2 Sessions at next GGF –Base spec comments –Next steps  Hope to link it properly to R-GMA

Enabling Grids for E-sciencE INFSO-RI Steve Fisher/RAL 13 For more information… EGEE Web pages: