OMII-Europe INFN-Grid A.Ghiselli INFN-CNAF Referee meeting, marzo 2007

What is OMII-Europe? (www.omii-europe.org) EU funded FP6 project (RI) Starting May 2006, initial 2 year duration (up to 4/08) 16 partners (8 European, 4 USA, 4 Chinese) Goal is to provide key software components for building e-infrastructures What will OMII-Europe do? Common interoperable services: Database Access, Virtual Organisation Management, Portal, Accounting, Job Submission and Job Monitoring Capability to add additional services Infrastructure integration Initial EGEE/UNICORE/Globus interoperability Interoperable security framework

OMII-Europe Vision To demonstrate that interoperable Grids can be built from standards-compliant Web Services and to deliver a set of quality-assured services, sourced from open source repositories, able to be used on the principal Grid infrastructures in use in Europe today.

OMII-Europe guiding principles Committed to standards process Implementing agreed open standards and working with standards process (GGF/Oasis) Quality Assurance Published methodology and compliance test All software components have public QA process and audit trail Working with similar projects and organisations to agree policies Impartiality OMII-Europe is “honest broker” providing impartial advice/information on e-infrastructures

What will OMII-Europe deliver? Repository of open-source, quality assured software services for EGEE, Globus, UNICORE and CROWNgrid Some services bundled with major grid distributions Initial integration work with EGEE, UNICORE and Globus Public reports on grid infrastructures Initial benchmark results Impartial advice and information Evaluation infrastructure to “test” services User support and training for services

OMII-Europe Project Partners 114 person years over 2 years, 5 million Euro, 4 major Grid infrastructures University of Southampton UK (coordinator) University of Chicago USA Fujitsu Laboratories Europe UK NCSA, University of Illinois USA Forschungszentrum Juelich Germany University of Southern California Los Angeles USA Kungl Tekniska Högskolan Sweden University of Wisconsin-Madison USA Istituto Nazionale di Fisica Nucleare Italy Beihang University China Poznan Supercomputing & Networking Center Poland China Institute of Computing Technology Beijing China University of Edinburgh UK Computer Network Information Centre Beijing China CERN, European Organisation for Nuclear Research Switzerland Tsinghua University China

INFN participation JRA1 activities (sviluppo middleware) VO oriented authentication and authorization Accounting Job submission and monitoring Database access Portal Interface JRA2 Identification of new services JRA3 Infrastructure Integration Common Security Infrastructure JRA4 Bench marking SA1 Repository SA3 Evaluation Infrastructure and Support

JRA1 – VO Management Activity Valerio Venturi, INFN-CNAF (coordinator) Collaboration: INFN, FZJ, FLE Goal: The definition and implementation of a web service compliant with the SAML Authorization model. Integration of VOMS into UNICORE. Upcoming Milestones/Deliverables: October 2006 : design documents April 2007 : complete prototype of SAML compliant VOMS interface Status sept.06: Outlining the role of VOMS in the authorization framework with respect to emerging Authz standard (WS, SAML). Discussion on version of standard to use. Investigation started on how VOMScredentials could be used in UNICORE's authorization framework. UNICORE will use SAML binding of VOMS credentials. Standardization work: Participation to the OGSA Authz WG to define the interface of the service. Request: Participation to OGF and project meetings.

Present status VOMS service using SAML READY basic service for those willing to use it for developments interface according to OASIS SAML set of specifications and agreements with OGF's AuthZ WG (exchange ongoing) https using EEC certificates (not proxies so far) build within ETICS (OMII-Europe project), code into the INFN cvs It is available on a OMII-Europe machine at CNAF 'besides' the SA3's VOMS server UNICORE integration working on the (internal) Unicore specification for transporting security related information, including VOMS assertions.

JRA1 Virtual Organization Management : plans Next milestone and deliverables PM12 M:JRA1.5 Feature complete alpha implementation VOMS SAML service no prob integration of VOMS in UNICORE no prob PM12 D:JRA1.5 deliverable reporting progress in the task and contribution to D:JRA1.1 overall activity deliverable VOMS service using SAML next steps PM12 add the database layer PM11 support https connection through proxy certificates PM12 using GT4 libraries Collaborate with and disseminate to other JRA1 activities (Database, Job Submission willing to use VOMS for authorization) UNICORE integration PM12 test the service using WS-Security to transport SAML assertions in a interaction between UNICORE nodes enhance the client to contact the VOMS server

JRA1 – Accounting Activity (coordination: KTH) Collaboration: KTH, INFN, FZJ, FLE, UEDIN, BU and CNIC. Goal: Interoperability between accounting systems (DGAS, SGAS, UNICORE) for unifying accounting information on different Grid environments (EGEE, UNICORE, GLOBUS); for this purpose: evaluation and implementation of the GGF Resource Usage Service (RUS) interface and the GGF Usage Record (UR). Upcoming Milestones/Deliverables: September 2006: Preliminary design documents. April 2007: Feature-complete prototypes of GGF-compliant RUS interfaces (for exchange of URs). Status: Preliminary planning of design; work of some partners was delayed by illness and staff recruitment. Standardization work: Active participation in the GGF RUS-WG (for an interface for accounting data exchange) and the UR-WG (Usage Record; the format of exchanged accounting data) are considered important. Request: Participation to OGF and project meetings.

INFN Accounting Activity Status Change in implementation plan (in agreement with the other task partners): INFN will provide a sensor (RUS client) that can publish usage information into a RUS service for M12: preliminary prototype creates UR documents, but doesn't yet forward them to a RUS service. The DGAS-RUS service will be implemented in project year 2: performance evaluation of the native XML database eXist for this purpose is ongoing. INFN staff: Michele Pace replaces R. Piro (left OMII-Europe in November 2006) R. Piro will continue to work in the OGF RUS-WG. Luca Tomassetti (UF di INFN-FE)

JRA1 – Job Submission Activity (coordination: Moreno Marzolla, INFN Padova) Collaboration: INFN, FZJ, FLE, UEDIN, SOTON, UCHIC, UWM Goal: Address the extension of the existing job submission systems within GLOBUS, UNICORE and EGEE to meet BES and JSDL standards. Specific extensions for projects such as EGEE will also be defined and fed back into the standardisation process. Upcoming Milestones/Deliverables: September 2006: Definition of the required JSDL extensions December 2006: BES will be evaluated with respect to its adoption in the middleware of the OMII-Europe partners Status JSDL is being integrated in the CREAM Computing Element and in the gLite infrastructure; work on BES specification is ongoing (see http://grid.pd.infn.it/omii) Requests Participation to GGF, EGEE2 and internal OMII coordination meetings

Present status M9 milestone MJRA1.17 is about BES Draft specification v26 has been implemented by Unicore and gLite in the context of SC'06 demo Early CREAM-BES and UNICORE-BES are available for testing: http://grid.pd.infn.it/omii/milestones:jra117 M12 “Mostly” complete support for BES and JSDL in gLite, UNICORE and Globus Client applications can submit the same job to different systems in the same way

workplan JRA3/Security Suitable authentication/authorization solutions should be adopted for secure job submission JRA1/VOMS Possible use of SAML assertions in BES servers? JRA2 GlueSchema is one of the topics which was selected by JRA2 for further investigation during the second year GlueSchema might be useful for expressing requirements in JSDL (at the moment, JSDL uses a limited set of ad-hoc elements)

JRA1 Database Coord. Univ. di Edimburgo Collaboration: UEDIN (coordination), FLE, INFN, FZJ, TU Goal Allow DB access from both EGEE and DEISA using a common services: OGSADAI Upcoming milestones : Evaluate the possibility of using OGSADAI using standard gLite authentication Evaluate the difficulty of porting needed library on WN to make the client run Evaluate the possibility to publish OGSADAI services on gLite information system Status : OGSADAI server installed (we have some S.O. problem) Need of a use case to make some useful tests Request: Participation to OGF, conference, project meeting

status M12: Evaluate the possibility of using OGSADAI using standard gLite authentication Interazione con il VOMS (V.Venturi) Evaluate the possibility to publish OGSADAI services on gLite information system Interazione con BDII (M.Verlato, S.Andreozzi) Input dall’esperienza di infn-ba sui test di OGSADAI in LIBI.

JRA2 – New Services Sergio Andreozzi INFN CNAF (coordinator) Collaboration: – INFN, UEDIN, KTH, BU, ICT, TU Goal to identify appropriate emerging middleware services from the global Grid initiativeI and priorities for the placement of such services in the OMIIEurope repository. Upcoming milestones : October 2006: publication of Grid Activities April 2007 report on the identification of new services Status : Definition of the template for comparing different Grid platform Description of gLite status and Investigation of partner's platform Request: Participation to OGF, conference, project meeting

Activity report What We Have Done D:JRA2.0 sent to EU Analysis and prioritization of new services available (http://omii-europe.forge.cnaf.infn.it/jra2/) What We are Doing Defining workplan for the identified services (http://omii-europe.forge.cnaf.infn.it/jra2/activities/) Started gathering new contributions/updates for D:JRA2.0 update What We will do Next Once the sub-contract is allocated Selection and hiring of new persons Start working on the selected tasks

JRA3 – Common Security Infrastructure coordination: Fredrik Hedman KTH INFN participation F: Paolo Andreetto (PD), Andrea Ferraro (CNAF) INFN participation UF: Alberto Gianoli (FE) Collaboration: KTH, INFN, FZJ, UILL, TU. Goal: To harmonise and define a core set of security features that will enable to make use of multiple middlewares with a single security infrastructure. Upcoming Milestones/Deliverables: May 2007: Definition of a common security technology base; first task report. November 2007: Prototype credential management system. May 2008: Last task report. Status in sept 06: Analysis of available security frameworks, waiting for people from KTH. Requests: Participation to GGF, EGEE2 meeting, ETICS meeting and tutorial. N.4 servers for development and tests (to be shared with JRA3 Integration) Status in mar 07 document on CSI - Common Security Infrastructure to the version 0.1.5. Defined new concepts of CSI/Snapshot, CIS/Reference and CSI/Implementation.

JRA3 – Infrastructure integration coordination: Morris Riedel FZJ (Unicore) INFN participation: Paolo Andreetto, Andrea Ferraro Collaboration: KTH, INFN, FZJ, UILL, TU. Goal: Closer integration of grid middleware distributions and higher levels of interoperability. Upcoming Milestones/Deliverables: May 2007: First prototype of the multi-platform grid infrastructure. May 2008: Final version of the multi-platform grid infrastructure. Status: Analysis of the available integration points; waiting for feedback from GT4. Requests: Participation to GGF, EGEE2 meeting, ETICS meeting and tutorial. N.4 servers for development and tests (to be shared with JRA3 Sec.Infr.) Status 3/07 Draft implementation of the information system integration between Glite and Unicore (work in progress).

JRA4 Benchmarking Coordination: KTH INFN participation (F): G JRA4 Benchmarking Coordination: KTH INFN participation (F): G. Fiorentino Collaboration: KTH, INFN, FZJ, BU ,CNIC. Goal: Integration of performance assessment tools in OMII-Europe repository Assessment of the performance of re-engineered and ported components avalaible in the OMII-Europe repository Development of tutorial material for the above tools Upcoming Milestones/Deliverables: March 2007 : First release of tools and supporting documentation in the repository, material made available to the training activity March 2008 : Second release of tools and supporting documentation in the repository Status 9/06: Existing tools and subsystems survey Analysis of requirements in order to develop future tools Work of some partners was delayed by illness and staff recruitment. Status 3/07: Started the adaptation of a KTH developed benchmarking tool for the mGLite Middleware

SA1 - Repository Coordination: Andrea Caltroni, INFN (funded) Partners: INFN (lead), CERN, SOTON, BU, CNIC Goal: establish a software repository to store software components, results of the benchmarking and compliance tests, documentation and training material developed in the other activities Deliverable/milestones: October 2006 : Implementation of the basic repository functionality October 2006: Implementation of the basic search functionality within OMIIUK Status: The high-level design document is being delivered. Existing repository tools are being evaluated. Work has started on the executive design and the design of the basic repository functionalities. Requests: Participation to project conferences Hardware for the repository servers

status Activity is 1-2 months late A decision has been taken to use the OMII-UK software as the basis of the OMII-Europe repository Decision is the result of a comparative analysis between Fedora, selected among many available open source tools and OMII-UK Basic repository functionalities (M:SA1.1) are provided as specified by D:SA1.0 A customized version of the software will soon be installed and made available to the public

SA3 – testbed & Support INFN participation (UF) : M.Verlato INFN-PD Partners: UEDIN (coord.), FZJ, PSNC, INFN, SOTON, BU, TU Goal to support the use of the repository components and ensure that these components can be effectively used Deliverables and Milestones: October 2006: support activity operation specification including evaluation infrastructure documentation and user support operations manual and evaluation infrastructure in place October 2006: user support in place including helpdesk, online support and bugreporting service Status: work has started with the evaluation of the RT ticketing system and a proposal for support procedures by UEDIN; evaluation testbed procured at FZJ and being deployed with Unicore 5 Requests: Evaluation Testbed per i servizi sviluppati dall’INFN a Padova: CREAM/BES, WMS, BDII, UI al CNAF: VOMS (2), DGAS, CREAM, GridICE, LFC, StoRM, WMS

Previsione ME 2007 sede ME per OGF e conferenze 1000euro per trasferta ME per all-hands e activity meeting ME per OGF e conferenze 1000euro per trasferta CNAF 4p*4 2p*2 3p*3 3 29.000euro 3.000 Padova 3p*4 3p*2 1*2 20.000euro Milano 1p*4 1p*2 1 6.000euro 1000 Ferrara 2 2.000