© 2008 Open Grid Forum Production Grid Infrastructure (PGI) 101 Morris Riedel, Balazs Konya, Moreno Marzolla OGF PGI Working Group Co-Chairs.

Slides:



Advertisements
Similar presentations
© 2006 Open Grid Forum Network Services Interface Introduction to NSI Guy Roberts.
Advertisements

© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources OGF 20 - Manchester, 7 May 2007.
© 2006 Open Grid Forum OGSA Next Steps Discussion Providing Value Beyond the Specifications.
© 2007 Open Grid Forum JSDL-WG Session 1 OGF25 – General Session 11:00-12:30, 3 March 2009 Catania.
© 2006, 2007 Open Grid Forum Michel Drescher, FujitsuOGF-20, Manchester, UK Andreas Savva, FujitsuOGF-21, Seattle, US (update) Extending JSDL 1.0 with.
CMS Applications Towards Requirements for Data Processing and Analysis on the Open Science Grid Greg Graham FNAL CD/CMS for OSG Deployment 16-Dec-2004.
Search Engines and Information Retrieval
OGF Standards Activity Steven Newhouse. © myOGF Part of the Standards Council Area Directror for Applications Working Groups Co-chair: Basic Execution.
© 2008 Open Grid Forum Grid Standards Realizing Basic Grid Use Cases Using Existing Standards and Profiles.
© 2006 Open Grid Forum Grid – path to pervasive adoption Mark Linesch - President, Open Grid Forum Hewlett Packard.
© 2008 Open Grid Forum Production Grid Infrastructure WG PGI Reference Model Towards an infrastructure interoperability reference model Morris Riedel (FZJ.
Search Engines and Information Retrieval Chapter 1.
© 2007 Open Grid Forum OGF Modeling Activities DMTF Alliance Partner Symposium Portland, 2007 July 18 Ellen Stokes
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
Managing Computational Activities on the Grid - from Specifications to Implementation: The GLUE 2 information model OGF25, 2nd March 2009, Catania Balázs.
Standards landscape and ARC development plans Péter Stefán KnowARC WP3 + NIIF.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
© 2006 Open Grid Forum DCI Federation Protocol BoF Alexander Papaspyrou, TU Dortmund University Open Grid Forum March 15-18, 2010, Munich, Germany.
JRA1/Job Submission and Monitoring Moreno Marzolla on behalf of JRA1/Job Submission Task INFN Sezione di Padova,
© 2008 Open Grid Forum Independent Software Vendor (ISV) Remote Computing Primer Steven Newhouse.
London e-Science Centre GridSAM Job Submission and Monitoring Web Service William Lee, Stephen McGough.
© 2006 Open Grid Forum Enabling Pervasive Grids The OGF GIN Effort Erwin Laure GIN-CG co-chair, EGEE Technical Director
© 2006 Open Grid Forum Service Level Terms Andrew Grimshaw.
© 2010 Open Grid Forum Standards All Hands Meeting OGF28, München, March 2010.
Oleg LODYGENSKY Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS, Orsay,
4° EGEE User Forum/OGF25 OGF-Europe’s 2° International Event Silvana Muscella, OGF.eeig Technical coordinator OGF-Europe
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
Role, Objectives and Migration Plans to the European Middleware Initiative (EMI) Morris Riedel Jülich Supercomputing.
EMI INFSO-RI Overview of the EMI development objectives Balázs Kónya (Lund University) EMI Technical Director EMI All Hands Prague, 23rd November.
Easy Access to Grid infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) Dr. Mathias Stuempert (KIT-SCC, Karlsruhe) EGEE User Forum 2008 Clermont-Ferrand,
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Grid Interoperability Update on GridFTP tests Gregor von Laszewski
© 2006 Open Grid Forum Activity Instance Schema Philipp Wieder (with the help of the JSDL-WG) Activity Instance Document Schema BoF Monday, 25 February,
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
© 2008 Open Grid Forum Grid Interoperation Now (GIN) Update & Applications Status of World-wide Interop Activities Morris Riedel (FZJ – Jülich Supercomputing.
1 st EGI CTA VT meeting 18 January 2013 C. Vuerli (INAF, Italy), N. Neyroud (CNRS/IN2P3/LAPP, France)
D.Spiga, L.Servoli, L.Faina INFN & University of Perugia CRAB WorkFlow : CRAB: CMS Remote Analysis Builder A CMS specific tool written in python and developed.
© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources OGF 21, Seattle, Tuesday 16 October 2007.
© 2006 Open Grid Forum BES, HPC, JSDL and GLUE Profiling OGF 23, Barcelona, Tuesday 16 October 2007.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
© 2008 Open Grid Forum PGI - Information Security in the UNICORE Grid Middleware Morris Riedel (FZJ – Jülich Supercomputing Centre & DEISA) PGI Co-Chair.
© 2007 Open Grid Forum Status Reviews and Plans Production Grid Infrastructure (PGI) - WG Morris Riedel et al. Juelich Supercomputing Centre PGI Co-Chair.
Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.
© 2008 Open Grid Forum PGI Working slides Understanding OGSA-BES Tunings – V.01 Morris Riedel (FZJ – Jülich Supercomputing Centre & DEISA) et al. OGF PGI.
© 2006 Open Grid Forum Grid Resource Allocation Agreement Protocol GRAAP-WG working session 1 Thursday, 5 March, 2009 Catania, Sicily.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI MPI VT report OMB Meeting 28 th February 2012.
JRA1/Job Submission and Monitoring
JRA1 Middleware re-engineering
OGF PGI – EDGI Security Use Case and Requirements
OGSA Data Architecture Scenarios
EMI Interoperability Activities
Middleware independent Information Service
OGF HPC Basic Profile Interoperability Demonstrator
Outline Introduction Objectives Motivation Expected Output
Interoperability & Standards
Status and Future Steps
Activity Delegation Kick Off
Leigh Grundhoefer Indiana University
Wide Area Workload Management Work Package DATAGRID project
Sergio Andreozzi (speaker) Laurence Field Balazs Konya
Global Grid Forum (GGF) Orientation
a middleware implementation
Introduction to OGF Standards
Morris Riedel (FZJ – Jülich Supercomputing Centre & DEISA)
gLite The EGEE Middleware Distribution
OGF 40 Grand BES/JSDL Andrew Grimshaw Genesis II/XSEDE
Sergio Andreozzi Laurence Field Balazs Konya
GIN & the Standards Activity
Presentation transcript:

© 2008 Open Grid Forum Production Grid Infrastructure (PGI) 101 Morris Riedel, Balazs Konya, Moreno Marzolla OGF PGI Working Group Co-Chairs

© 2008 Open Grid Forum 2 Goals of this talk Understand the motivation of the Production Grid Infrastructure (PGI) working group Provide an introduction to the approach of the PGI group instead of providing technical pieces of information Clarify the goals of PGI Highlight the relationshop between GIN and PGI

© 2008 Open Grid Forum Motivation Members of GIN have been working within the OGF to explore the interoperability issues in: jobs submission and job monitoring data access and movement authentication and authorization information representation and discovery Our Goal: Define a working profile including all the above, around a well-defined use case

© 2008 Open Grid Forum Use Case On behalf of an authorized user, a tool interrogates the information system and locates an optimal execution resource The job is submitted to the execution resource The execution resource interprets the submitted job description, and locates and fetches the necessary input data from a remote storage on behalf of the user Upon completion, the output data is uploaded to a storage resource where this user is authorized, registered in the necessary data indexing catalogs, and the job record is updated in the accounting and monitoring system.

© 2008 Open Grid Forum 5 Issues which will be investigated How to efficiently query a Grid Information System? Extend the BES basic resource model taking into consideration the GLUE2 specification Adapt the JSDL:Resource element accordingly How to securely access staged in/out data on behalf of the user? Security should be integrated inside the BES/JSDL/.. specifications, not on the top of them How monitoring/accounting information is going to be updated by the BES execution service? Taking into consideration the Grid user identity which must be transmitted to the BES endpoint

© 2008 Open Grid Forum 6 PGI Goals #1 Prio: Take production Grid experiences into account Apply real e-science applications to check necessary PGI- compliant functionality on GIN infrastructures Formulate a well-defined set of profiles, and additional specifications if needed… For job and data management that are aligned with a Grid security and information model Standardize missing links between different open standard specifications E.g. How to perform an SRM data staging in JSDL documents during a secure OGSA-BES-based job submission Base upon already existing specifications… OGSA-Basic Execution Services (GFD.108), Job Submission Description Language (GFD.136), GridFTP (GFD.20), Storage Resource Manager (GFD.129), and efforts of the GLUE2 Provide feedback to these specifications if possible

© 2008 Open Grid Forum OGF Grid Interoperation Now (GIN) Community Group e-Science applications using standards deployed in Grids Real practical applications that require interoperability Is not allowed to do standardization OGF Production Grid Infrastructure (PGI) Working Group Profile/Standardize a well-defined set of open standards (i.e. OGSA-BES, SRM, JSDL, …) Focus on missing links between emerging open standards Take production experience from GIN into account PGI and GIN complement each other Contacts Page: Relationship with GIN

© 2008 Open Grid Forum 8 PGI Approach Start with existing specifications Check which functionality is missing in those specifications that are required in GIN infrastructures (Maybe even reduce overhead implied by specifications) Once the specifications have been tuned for production Grid needs, we focus on the problems of using them together in real applications  missing links PGI will try to standardize those well-known missing links in conjunction with the tuned specifications Test these set of profiles/standards/extensions in collaboration with GIN and their early interoperability use case applications Since many standards are already adopted, the PGI approach should make fast progress having a first reasonable good set ready in 2009

© 2008 Open Grid Forum Goals Production Grid Infrastructure Roadmap Document (GFD-I) Provides an overview of missing links between open standards and the fundamental motivation for standardization of the production grid infrastructure profiles Secure Job and Data Management Profile in Production Grids (GFD-R-P) Develop a job/data/security profile assuming a deployed computing endpoint is already known by an end-user Secure Information Profile in Production Grids (GFD-R-P) Allows a user to discover resources that are appropriate for their request and that they are authorized to access Secure Accounting Profile in Production Grids (GFD-R-P) Develop an accounting profile that allows services to securely update a service within information about the resources they have used on behalf of a user Secure Monitoring Profile in Production Grids (GFD-R-P) Develop a profile that allows services to securely record in a service the progress of an activity.

© 2008 Open Grid Forum Milestone Come to a common proven end-to-end interoperable definition of the services and their interactions within the next 18 months The development work will take place within this time period We feel it is imperative to attempt to do this work within OGF.

© 2008 Open Grid Forum Practical aspects Weekly teleconference Friday, 4:00 PM CET Organized by the co-chairs Announcements to be circulated on the mailing list First teleconference Friday, Jan 9 F2F Kick-off meeting to be organized Possibly before next OGF in Catania Three PGI working sessions booked at next OGF in Catania