Sergio Andreozzi (speaker) Laurence Field Balazs Konya

Slides:



Advertisements
Similar presentations
GLUE 2.0 and GLUEMan Sergio Andreozzi, INFN-CNAF, Bologna (Italy) OGF Feb 2008, Cambridge, MA, USA.
Advertisements

© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources OGF 20 - Manchester, 7 May 2007.
© 2006 Open Grid Forum Glue-WG Sergio Andreozzi – INFN-CNAF 31 January 2007.
© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources (OGSA Modeling Activities) OGF 21 - Seattle, 16 October 2007.
Grid Standardization from the NorduGrid/ARC perspective Balázs Kónya, Lund University, Sweden NorduGrid Technical Coordinator ETSI Grid Workshop on Standardization,
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.
Building components for Grid Interoperability Stephen Brewer, Deputy Project Manager, OMII-Europe OGF 22 – Boston, MA.
© 2007 Open Grid Forum OGF Modeling Activities DMTF Alliance Partner Symposium Portland, 2007 July 18 Ellen Stokes
© 2006 Open Grid Forum Information Modeling of Grid Resources: the OGF GLUE WG Approach DMTF Symposium - Portland, 17 July 2007 Sergio Andreozzi INFN-CNAF,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse OGF 25, Catania Defining.
D-MON TeamCGW 08 Adopting GLUE 2.0 for Interoperation of Grid Monitoring Systems Timo Baur, Rebecca Breu, Tobias Lindinger, Anne Milbert, Gevorg Pogoshyan,
Managing Computational Activities on the Grid - from Specifications to Implementation: The GLUE 2 information model OGF25, 2nd March 2009, Catania Balázs.
JRA1/Job Submission and Monitoring Moreno Marzolla on behalf of JRA1/Job Submission Task INFN Sezione di Padova,
© 2008 Open Grid Forum Independent Software Vendor (ISV) Remote Computing Primer Steven Newhouse.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Felix Ehm CERN IT-GD EGEE 2008 GLUE 2.0.
© DATAMAT S.p.A. – Giuseppe Avellino, Stefano Beco, Barbara Cantalupo, Andrea Cavallini A Semantic Workflow Authoring Tool for Programming Grids.
© 2006 Open Grid Forum Enabling Pervasive Grids The OGF GIN Effort Erwin Laure GIN-CG co-chair, EGEE Technical Director
Interoperability in OMII – Europe (using the new standard compliant SAML-based VOMS to handle attribute-based authz.) Morris Riedel (FZJ), Valerio Venturi.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks State of Interoperability Laurence Field.
EGEE is a project funded by the European Union under contract INFSO-RI Copyright (c) Members of the EGEE Collaboration GLUE Schema Sergio.
Oleg LODYGENSKY Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS, Orsay,
Conference name Company name INFSOM-RI Speaker name The ETICS Job management architecture EGEE ‘08 Istanbul, September 25 th 2008 Valerio Venturi.
Towards a WBEM-based Implementation of the OGF GLUE Information Model Sergio Andreozzi, INFN-CNAF, Bologna (Italy) Third EGEE User Forum 13 Feb 2008, Clermont-Ferrand,
RUS: Resource Usage Service Steven Newhouse James Magowan
Status Organization Overview of Program of Work Education, Training It’s the People who make it happen & make it Work.
Easy Access to Grid infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) Dr. Mathias Stuempert (KIT-SCC, Karlsruhe) EGEE User Forum 2008 Clermont-Ferrand,
INFSO-RI Enabling Grids for E-sciencE Summary of NAREGI discussions on GLUE/CIM Sergio Andreozzi INFN-CNAF March 24, 2006 – JRA1.
© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources OGF 21, Seattle, Tuesday 16 October 2007.
© 2006 Open Grid Forum BES, HPC, JSDL and GLUE Profiling OGF 23, Barcelona, Tuesday 16 October 2007.
GGF - © Birds of a Feather - Policy Architecture Working Group.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
© 2008 Open Grid Forum Production Grid Infrastructure (PGI) 101 Morris Riedel, Balazs Konya, Moreno Marzolla OGF PGI Working Group Co-Chairs.
Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.
© 2006 Open Grid Forum GLUE Entities OGF 22 - Boston, 27 Feb 2008.
EMI is partially funded by the European Commission under Grant Agreement RI EMI Status And Plans Laurence Field, CERN Towards an Integrated Information.
© 2010 Open Grid Forum GLUE WG - Introduction OGF30, Brussels – 28 Oct 2010 Sergio Andreozzi (EGI.eu) Balazs Konya (Lund University) Laurence Field (CERN)
JRA1/Job Submission and Monitoring
Update to the Community GGF16 - Athens
Models for Resources and Management
Monitoring and Information Services Technical Group Report
Towards GLUE Schema 2.0 Sergio Andreozzi INFN-CNAF Bologna, Italy
Management and Manageability in OGSA
EMI Interoperability Activities
Resource monitoring and discovery in OGSA
Grid Scheduling Architecture – Research Group
Hiro Kishimoto, OGSA-WG co-chair GGF16 in Athens February 13, 2006
TeraGrid’s GLUE 2 Implementation
Building Components for Grid Interoperability
Infrastructure Support
Interoperability Markus Schulz For EGEE-II SA3 IT Department, CERN
OGSA Status and Future GGF13 March 14, 2005 in Seoul
Coordination of Middleware Development & Standardization
EMI-ES demo Emidio Giorgio INFN Catania
Why does EDGeS need OGF PGI ?
Status and Future Steps
A conceptual model of grid resources and services
Management Area ‘Status at a glance’
Leigh Grundhoefer Indiana University
Universal Dynamic Activity Package - Concepts
OGSA and Security Services GGF12 , September 20th, 2004 Hiro Kishimoto
Report on GLUE activities 5th EU-DataGRID Conference
Building components for Grid Interoperability
EGEE Middleware: gLite Information Systems (IS)
Management Area Session
OGF19 – Chapel Hill, NC, USA 30 January 2007
GLUEMan: A WBEM-based Implementation of GLUE 2.0
Sergio Andreozzi Laurence Field Balazs Konya
GIN & the Standards Activity
Presentation transcript:

Sergio Andreozzi (speaker) Laurence Field Balazs Konya GLUE 2.0 Sergio Andreozzi (speaker) Laurence Field Balazs Konya OGF24, Singapore, 17 Sep 2008

OUTLINE OGF GLUE WG and GLUE 2.0 Problem Description WG Activity Status and Plans 2

User Needs Vs. Resource Characteristics Where can I run a job requiring OS Linux, IA64 architecture, with software package X and Y As part of the VO A, how much storage can I use on the Grid? I offer 15 TB of storage, 10 TB are free and usable by GREEN VO I can offer IA64 machines with OS Linux using BES interface to users of BLUE VO 3

Problem Statement Resources have heterogeneous characteristics Service Interfaces are yet heterogeneous Converging towards common standards Users have needs to be satisfied How to describe resources/services shared in Grid systems in order to enable: Resource awareness Resource discoverability Resource requirements expression Resource basic monitoring 4

Current Situation Several Grid infrastructures using different schema definitions The most widely deployed schema definition is GLUE Schema 1.x Designed to support service/resource selection Adopted by gLite and other Grid middlewares Other schemas exist: e.g.: NorduGrid, TeraGrid, NAREGI For interoperable Grids, we need to unify the modeling of Grid resources into a community standard 5

OGF GLUE WG New OGF Working Group approved at OGF 19 (Jan 2007) Co-chairs: Sergio Andreozzi (OMII-Europe->OGF-Europe, INFN) Laurence Field (EGEE) Balazs Konya (NorduGrid) Focus: facilitate interoperability between Grid infrastructures via common information models and reference implementation for describing Grid resources in response to use cases Goal: define a use case document collecting use cases from different Grid projects/infrastructures define a conceptual model defining the abstract schema GLUE 2.0 satisfying the collected use cases. develop reference implementations Unify modeling approaches and experience in production systems 6

Contributors to OGF GLUE Planning for Adoption OMII-Europe EGEE ARC TeraGrid UNICORE DEISA D-Grid AustralianGrid NAREGI NGS OSG BREIN 7

Relationship to other OGF WGs BES/HPC JSDL SAGA Used to describe exposed resources Used to express requirements in Common service descripton for discovery API To be consistent with GLUE UR Used to describe exposed resources Should fit into the picture GSM OGSA Res.Mgt. Should fit into the picture Reference Model SAGA:Simple Access Grid API JSDL: Job Submission Description Language GSM:Grid Storage Management BES: Basic Execution Service 8

OGF Information Modeling Architecture OGF Reference model specialization End-user CIM consistent with OGF GLUE Information model based on based on based on Activity requirements transformation Managed Grid Resource Instance Advertised Capabilities Matching resources Check this OGF doc http://forge.ogf.org/sf/go/doc13726 9

OGF GLUE Documents Two documents have recently terminated the Public Comment period GLUE Specification – v.2.0 Conceptual model in three sub-models Main Entities Computing Entities Storage Entities GLUE v. 2.0 – Reference Realizations to Concrete Data Models XSD SQL LDAP GLUE Use Cases – live document 10

OFFICIAL PERIOD OF PUBLIC COMMENT ENDED 13 Aug 2008 11

Received Comments http://forge.ogf.org/sf/go/doc15230 GLUE 2.0 Specification http://www.ogf.org/gf/docs/comment.php?id=258 18 posts Realizations http://www.ogf.org/gf/docs/comment.php?id=259 4 posts plus pending issues postponed after public comment period http://forge.ogf.org/sf/go/doc15230 60 individual items 12

Implementation Status Available the following renderings: XSD SQL DDL LDAP Schema Information Providers UNICORE and ARC already have partial support GLUEMan, framework to help integrating info providers available from INFN http://glueman.sf.net/ 13

Profiling Usage of GLUE with other OGF Specs 1/2 The OGF GLUE WG discussed how GLUE can be integrated with BES: expose GLUE information JSDL: express requirements using GLUE vocabulary Discussion was held in previous OGF editions see: http://www.ogf.org/OGF23/materials/1274/GLUE-BES-HPC-Profile.ppt 14

Profiling Usage of GLUE with other OGF Specs 2/2 OGF-Europe is stimulating adoption of Grid standards via focused actions A workshop was organized at CERN to define what GLUE/JSDL/BES need in order to be used in production scenarios by EGEE/UNICORE/ARC Go to the following session for an update report GIN-CG - Session I: Status of World-wide Interop Activities Today, 2:15 pm - 3:45 pm, Breakthrough Room http://ogf.org/gf/event_schedule/index.php?id=1408 15

What’s Next Need to resume regular phone-conferences to digest all the comments and move to final version From October ’08 Next Milestone – OGF25 Proposed Recommendations for Spec and Realization ready Preliminary Implementation Experience reports 16

References OGF GLUE Working Group GLUE 2.0 Documents http://forge.ogf.org/sf/sfmain/do/viewProject/projects.glue-wg GLUE 2.0 Documents http://www.ogf.org/pipermail/glue-wg/2008-May/000740.html OGSA Information Modeling Architecture http://forge.ogf.org/sf/go/doc13726 17

GLUE 2.0 - Overview 18

Main Entities 19

20

Complex Computing Service BLUE VO GREEN VO GLUE 2.0 concepts CREAM-BES CREAM UserDomain AdminDomain blue share green share ComputingService ComputingEndpoint OpenPBS ComputingShare #50 P4 2 GHz, 1 GB RAM #50 Xeon 5160 2.66 GHZ, 4 GB RAM ComputingManager ExecutionEnvironment ApplicationEnvironment 21 AdminDomain

22

GLUE 2.0: Storage Entities by Example BLUE VO GREEN VO GLUE 2.0 concepts blue share green share UserDomain AdminDomai StoRM StorageService GPFS StorageEndpoint 10 TB Disk StorageShare StorageManager StorageResource AdminDomain 23