The European DataGrid Project Team http://www.eu-datagrid.org The GENIUS Grid Portal The European DataGrid Project Team http://www.eu-datagrid.org

Overview GENIUS Portal: architecture and relationships with EDG Middleware EnginFrame as a multi-purpose framework for computational and data grids The EDG services in the GENIUS Portal File Services Job Submission Services Interactive Services Other Services shown in other presentations Summary and perspectives The main points touched by this lecture: - What is the definition of GRID computing ? - How can we define a GRID testbed? - Which are the main reasons for us to use GRIDS ? We will see how GRIDs address most of the challanging issues we are currently faced to if we want to carry frontieer Research activities in many different scientific domains. - How is the European Data Grid structured, organized ? Which are its goals ? This are the questions we will be answering.

EDG M/W: around the web portal idea EDG software (Globus, UI, JDL, WP2, WP3, etc.) contains tens of commands/switches which also have their own logical sequences. Browsing Grid VO “directories” (users, RC’s, DB’s, etc.) requires LDAP “speaking” and tomorrow could require SQL “speaking”. “User gridification” is a tough task for a “rookie”  this does not fit with the claim that “grids” are for everybody and that grid computing will be as easy as surfing the Internet ? Furthermore, all this holds for DataGrid. What will happen when other grids’ software (especially UI’s) will come up (PPDG, iVDGL, etc.) ? Will users have to learn tens of “grid dialects” ? Today “grid computing” is a rather complicated experience for un- experienced user only possible at selected machines (UI’s)  this does not fit with the claim that one could do “grid computing” even from a PDA ? Is there any way to set-up a “user-friendly” grid ?

A Web Portal: why and how? It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, WAP phone). It can keep the same user interface to several back-ends (grid “dialects”  command-line UI’s). It must be redundantly “secure” at all levels: 1) secure for web transactions, 2) secure for user credentials, 3) secure for user authentication, 4) secure at VO level. All available grid services must be incorporated in a logic way, just “one mouse click away”. Its layout must be easily understandable and user friendly.

A little bit of history 1998-1999 2000-2001 2002-now graphic interface to LSF (multi) clusters for ALICE jobs 2000-2001 simple but effective web portal to submit ALICE jobs to the grid using EnginFrame and GLOBUS 2002-now official grant of the INFN Grid Project to collaborate with NICE srl to integrate in a web portal all services offered by the DataGrid middle-ware; adoption/contributions by other experiments

NICE Background Networking Information Communication Engineering Distributed Resource Management LSF, projects, consulting System Administration VENUS, consulting, support Unix - Windows NT integration Computing Portals EnginFrame, projects and consulting Web, Java, XML competence Expertise in Citrix MetaFrame on NT & Unix

NICE Customers/Partners Research INFN, ENEA, ICTP, CASPUR, CILEA, CNR, Astronomical & Astrophysical Observatories Mechanical Ferrari, FIAT Avio, CRF, Comau, Iveco, ELASIS, Marelli, UTS, Teksid, Brembo, Lear Energy ABB, Ansaldo, Nuovo Pignone, ENEL, EniChem, Enterprise Oil, Agip BioTech Pharmacia, (ENEA) Aerospace Alenia, Galileo, IDS Electronics ST Microelectronics, Accent, Alcatel, Ericsson, Siemens Telecom Telecom Italia, Italtel, CSELT Education Scuola Normale Superiore di Pisa, Polit. Of Milan, Universities Partners HP, IBM, NEC, SGI, Sun, Avaki Consulting Accenture, Elsag, ITGlobalValue NICE srl Networking Information Communication Engineering

High level Grid middleware EDG Globus-based middleware architecture Current EDG architectural functional blocks: Basic Services (authentication, authorization, Replica Catalog , secure file transfer, Info Providers) rely on Globus 2.0 Higher level EDG middleware (developed within EDG) Applications (HEP,BIO,EO) Specific application layer ALICE ATLAS CMS LHCb Other apps VOs common application layer LHC Other apps Grid middleware High level Grid middleware GLOBUS 2.0 Basic Services OS & Net services

[https://genius.ct.infn.it] INFN/NICE srl collaboration GENIUS® (Grid Enabled web eNvironment for site Independent User job Submission) [https://genius.ct.infn.it] INFN/NICE srl collaboration GENIUS web portal Specific application layer ALICE ATLAS CMS LHCb Other apps VOs common application layer LHC Other apps Grid middleware High level Grid middleware GLOBUS 2.0 Basic Services OS & Net services

the Grid GENIUS: how it works https+java/xml+rfb WEB Browser GENIUS 3-tier model https+java/xml+rfb WEB Browser GENIUS Local WS EnginFrame Apache the Grid EDG+GSI EDG UI

Enginframe in brief Standards-based GRID portal framework Java, Tomcat/JServ, Apache, XML/XSL → GridML Solves back-end integration problems Visual rendering for most Grid objects jobs, job arrays, hosts, services, databases, etc. Multiple Grid & Cluster technologies support EDG, Globus, LSF, SGE, Condor (soon) Authentication delegation (GSI,MyProxy, AFS, NIS, NT, Kerberos V, ...) Data management: UL/DL + remote (multi-) file browsing Integration with interactive apps End-user oriented focus! application integration

3-Tier Computing Portal with EnginFrame X / VNC / ICA connections Application Server MetaFrame + NFuse Clients Web Server Browsing request Service request EnginFrame GlobusAgent LSF Agent NFuse Agent ... EnginFrame Server and Repository Standard Web Browser HTML Rendering XML Output GLOBUS Grids LSF Compute Farm

Service Example <ef:service id="gzip"> <ef:name>gzip sample</ef:name> <ef:option id="level" label="Compression level" type="list"> <ef:option id="9">maximum</ef:option> <ef:option id="4">medium</ef:option> <ef:option id="0">none</ef:option> </ef:option> <ef:option id=”FILE" label="File to compress" type="file"/> <ef:action id="submit" label="Submit job"> EF_SPOOLER_NAME="gzip $file” export EF_SPOOLER_NAME ${EF_ROOT}/plugins/lsf/bin/bsub -o output.txt gzip -$level \"$FILE\” <ef:result type="text/xml"/></ef:action> </ef:service>

Choosing the right layout One very effective method is to select one existing page from your Intranet/Internet site You need to identify a page where you can figure out the space for the service navigation bar and the service content area

GENIUS Portal HomePage

GENIUS: File Services

GENIUS: File Services OS Authentication !

GENIUS: File Services – Create a File

GENIUS: File Services – Create a File

GENIUS: File Services – View a File Remote File browser

GENIUS: File Services – View a File

GENIUS: File Services – View a File

GENIUS: File Services – Edit a File

GENIUS: File Services – Edit a File

GENIUS: File Services – Edit a File

GENIUS: File Services – Rename a File/Dir

GENIUS: File Services – Rename a File/Dir

GENIUS: File Services – Rename a File/Dir

GENIUS: File Services – Delete a File/Dir

GENIUS: File Services – Delete a File/Dir

GENIUS: File Services – Create a Directory

GENIUS: File Services – Create a Directory

GENIUS: File Services – Upload a Tar ball Local File browser

GENIUS: File Services – Upload a Tar ball

GENIUS: VO Dissemination

GENIUS: VO Dissemination

GENIUS: VO Dissemination

GENIUS: VO Dissemination – Browse Users

GENIUS: VO Dissemination – Browse RC Grid File browser

GENIUS: VO Dissemination – Navigate SE

GENIUS: VO Dissemination – Navigate SE

GENIUS: Job Services

GENIUS: Job Services MyProxy Authentication !

GENIUS: Job Services – Job Editor

GENIUS: Job Services – Job Editor Minimum information required

GENIUS: Job Services – Job Editor NICE srl/Datamat collaboration

GENIUS: Job Services – Job Editor

GENIUS: Job Services – Job Editor

GENIUS: Job Services – VO selection

GENIUS: Job Services –Single Job OS Authentication !

GENIUS: Job Services – Single Job

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob Job Submitted !! No prior knowledge of Job Submission needed by the users !!

GENIUS: Job Services – SingleJob with automatic refresh every 5 minutes

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob –Job Data

GENIUS: Job Services – SingleJob

GENIUS: Job Services – SingleJob

GENIUS: Job Services - MultiJob

GENIUS: Job Services - MultiJob Remote Multi-File browser n jobs x m cycles

GENIUS: Job Services – MultiJob

GENIUS: Job Services - MultiJob

GENIUS: Job Services - MultiJob

GENIUS: Job Services - MultiJob

GENIUS: Job Services - MultiJob

GENIUS: Job Services - MultiJob

GENIUS: Job Services - MultiJob

GENIUS: Interactive Services

GENIUS: Interactive Services

GENIUS: Interactive Services

GENIUS: Interactive Services

GENIUS: Interactive Services

GENIUS: Interactive Services

GENIUS: Interactive Services

GENIUS: Interactive Services

GENIUS: Interactive Services

GENIUS: Interactive Services

GENIUS: VO Services - CMS

GENIUS: VO Services - CMS

GENIUS: Statistics

GENIUS: Summary and perspectives Current implementation of GENIUS includes more than 100 services. Among them: secure web transactions, user authentication and authorization; grid authentication “à la MyProxy” ! remote interaction with the user’s and “grid” file system; interfaces for job submission/control, data management, VO servers, and monitoring systems; several Resource Brokers and VO’s available; persistent (user level) book-keeping and spooler system; secure interactive analysis with TightVNC full support for “parallel” multi-jobs (“sequential” ones soon) web guided job description (from DATAMAT / NICE srl collaboration) CVS available ! Next future: Participation to the GGF Grid Portal Manifesto and GCE Working Group. Integration of IMS (Jabber) for real-time peer to peer collaboration within a VO