FESR Consorzio COMETA - Progetto PI2S2 Il portale grid: GENIUS Alberto Falzone NICE srl Consorzio COMETA – Progetto PI2S2 Tutorial per l’Università di Catania Catania,

Technical Training Catania, PI2S2, Contents Grid Portals technology GENIUS Portal Some Integrated Applications Future perspectives

Technical Training Catania, PI2S2, What is a Grid Portal? A Grid Portal is a system to expose grid services that operate on grid resources Services are: –generic as well as application-specific grid services Resources are (stateful) instances of: –jobs, datasets, computing/storage nodes, queues, SW licenses Services are exposed through: –(X)HTML, Portlets, WebServices

Technical Training Catania, PI2S2, Grid Portal Benefits A Grid Portal improves usability of Grids –Verticalizing the service offering –Lowering end-user requirements for accessing the Grid –Hiding the complexity of data management in the Grid A Grid Portal improves utilization of Grids –Making the Grid (r)evolution transparent to the end-user –Providing an appealing user-friendly Web interface –Enforcing Grid utilization policies

Technical Training Catania, PI2S2, The Web-centric vision Licenses & Data Licenses & Data Grid / Compute Farm Grid / Compute Farm Interactive Apps Interactive Apps Inter/Intranet Server(s) Clients Standard Web Browser

Technical Training Catania, PI2S2, The Grid Portal / Gateway Interactive Applications Intranet Clients Win LX UXMac Grid / Compute Farm Internal Users Batch Applications Storage and Data Grid Portal / Gateway Project Managers Client Apps Standard protocols Licenses Home Users

Technical Training Catania, PI2S2, Contents Grid Portals technology GENIUS Portal Some Integrated Applications Future perspectives

Technical Training Catania, PI2S2, What is GENIUS? GENIUS is a powerful Grid Portal that allows scientists to exploit Grid resources only using a conventional Web browser It’s a gateway to European EGEE Project’s middle- ware It has been built on top of the EnginFrame framework It allows to expose gLite-enabled applications via Web-browser as well as Web Services

Technical Training Catania, PI2S2, The GENIUS hourglass model OS & Net services Basic Services High level GRID middleware ALICEATLASCMSLHCb Applications’ specific layer Other apps GLOBUS toolkit EGEE (LCG/gLite) architecture GENIUS web portal GENIUS Grid Enabled web eNvironment for site Independent User job Submission INFN / NICE Collaboration

Technical Training Catania, PI2S2, GENIUS Architecture Apache + Tomcat EnginFrame GENIUS https+java/xml+rfb WEB Browser UI Local WS the Grid M/W+GSI 3-tier model

Technical Training Catania, PI2S2, Globus middleware Compute resources EGEE middleware LCG-2 / gLite Local Data Distributed Data WSDL/SOAP 3rd party Apps HTTP RSS Clients JSR168 Portlet Contaiers Classic GENIUS Authentication – ACL management General XML Application Kits Data Management & Virtualization VO n - XML Application Kit VO 1 - XML Application Kit Monitoring & Accounting VNC remote Desktop over SSL MyProxy auth. w/ VOMS extensions GENIUS as Grid Gateway End users Presentation engine Portlet GW WS GW RSS GW

Technical Training Catania, PI2S2, GENIUS Terminology Service – anything that can be submitted through GENIUS Portal SDF – Service Definition File: XML file which contains the definitions of services Authorization & Authentication – a system aimed to allow/deny user access to resources based on policies Plug-in – a piece of code that enhances the GENIUS GRID Portal Spooler – data container created by GENIUS to host the submitted commands

Technical Training Catania, PI2S2, Spoolers HTML page GENIUS Working Environment Custom plugin Script Browser SDF XML EnginFrame Server HTML XSLT Grid Compute Farm Grid Compute Farm MetaFrame + NFuse MetaFrame + NFuse Application Server Application Server EnginFrame Agent Execute Service Req XML output Service Req User Authorize Groups, ACLs XML Layout XSL Admin Service Submission

Technical Training Catania, PI2S2, GENIUS Grid Portal Reference Web Site:

Technical Training Catania, PI2S2, Layout structure: –Left navigation tree with the list of services –Central "content" area with forms and output from services –Top Menu area Customizing the layout - Structure

Technical Training Catania, PI2S2, Creating a SDF – example <ef:agent id="myagentname" authority="${EF_DEFAULT_AUTHORITY}“ xmlns:ef=" EnginFrame Grid Portal Welcome to EnginFrame <ef:location host="${EF_AGENT_HOST}" port="${EF_AGENT_PORT}"/> …

Technical Training Catania, PI2S2, Services Example gzip sample maximum medium none EF_SPOOLER_NAME="gzip $file” export EF_SPOOLER_NAME ${EF_ROOT}/plugins/lsf/bin/bsub -o output.txt gzip -$level \"$FILE\”

Technical Training Catania, PI2S2, GENIUS: security infrastructure All web transactions are executed under the Secure Socket Layer (SSL) via HTTPS The user must have an account on the User Interface When the user wants to interact with the file-system of the UI, he gets prompted for the username and password of the account on that machine Grid authentication in GENIUS is currently based on the concept Proxy

Technical Training Catania, PI2S2, GENIUS: files management OS authority Both authorities os and genius are distinct: we have services with differen authority!

Technical Training Catania, PI2S2, GENIUS: files management Remote File Browser On the User Interface

Technical Training Catania, PI2S2, GENIUS: files management

Technical Training Catania, PI2S2, GENIUS: files management Multiple Action in a Single Service

Technical Training Catania, PI2S2, GENIUS: Grid Authentication with Myproxy myproxy-get-delegation

Technical Training Catania, PI2S2, Grid authentication with MyProxy UI Local WS MyProxy Server GENIUS Server (UI) myproxy-init any grid service myproxy-get-delegation output the Grid execution WEB Browser Now, VOMS Extensions needed to run jobs on the GRID ( --voms )

To change: View -> Header and Footer Catania, PI2S2, Grid authentication with MyProxy UI Loc al WS MyProxy Server GENIUS Server (UI) myproxy-init (proxy+myproxy passphrase) any grid service myproxy-get-delegation output the Grid execution WEB Browser

To change: View -> Header and Footer Catania, PI2S2, A proxy from MyProxy subject : /C=IT/O=GILDA/OU=Personal Certificate/L=INFN Catania/CN=Valeria issuer : /C=IT/O=GILDA/OU=Personal Certificate/L=INFN Catania/CN=Valeria identity : /C=IT/O=GILDA/OU=Personal Certificate/L=INFN Catania/CN=Valeria type : unknown strength : 512 bits path : /tmp/x509up_u515 timeleft : 11:59:20 >myproxy-init ( Enter GRID pass phrase for this identity:…Enter MyProxy pass phrase:…Verifying password-Enter MyProxy pass phrase:… ) >myproxy-get-delegation (Enter MyProxy pass phrase:……) USER from command line interface: GENIUS service:

To change: View -> Header and Footer Catania, PI2S2, Coming soon.... 1st Solution GENIUS Server (UI) MyProxy Server Loc al WS WEB Browser VOMS Server the Grid execution APPLET User Private key and User Certificate MyProxyInit Java Applet Create a proxy with AC (12h) (chain =1) Store a proxy with AC (12h) (chain = 2) myproxy-get- delegation with AC(12h) (chain = 3) GSI Pure VOMS JAVA API https+java/xml+rfb

To change: View -> Header and Footer Catania, PI2S2, Coming soon nd Solution GENIUS Server (UI) Loc al WS WEB Browser VOMS Server the Grid execution APPLET User Private key and User Certificate VOMSProxyInit Java Applet Create a proxy (chain =1) GSI Proxy Create a new proxy with AC (chain =2) voms-proxy-init –voms voms –cert …. in waiting pure VOMS JAVA API Server Daemon 2nd Solution

To change: View -> Header and Footer Catania, PI2S2, Next Developments GENIUS Server (UI) Loc al WS WEB Browser VOMS Server the Grid execution APPLET User Private key and User Certificate VOMSProxyInit Java Applet Create a proxy with AC (12h) (chain =1) GSI Proxy Server Daemon GSI

To change: View -> Header and Footer Catania, PI2S2, GENIUS VOMS Proxy Init service

To change: View -> Header and Footer Catania, PI2S2, GENIUS VOMS Proxy Init service

Technical Training Catania, PI2S2, GENIUS: security Transparent VOMS Support

Technical Training Catania, PI2S2, GENIUS: preferences

Technical Training Catania, PI2S2, GENIUS: Job Submission Preferences are on the horinzontal bar after successful login to the Grid (under genius authority)

Technical Training Catania, PI2S2, GENIUS: Job Editor for jdl files

Technical Training Catania, PI2S2, GENIUS: Job Queue Code for Job Queue management rewritten using GridML tags

Technical Training Catania, PI2S2, GENIUS: Get Output New Confirmation Message!

Technical Training Catania, PI2S2, GENIUS: Job Queue - Spooler

Technical Training Catania, PI2S2, GENIUS: Interactive Tight VNC

Technical Training Catania, PI2S2, GENIUS: Data & Grid Catalogs Local Browse on laptop Remote Browse on UI (GENIUS Server) Extended Remote File Browse on LFC Catalog

Technical Training Catania, PI2S2, GENIUS: Data & Grid Catalogs Extended Multiple Remote File Browsing on Catalog!

Technical Training Catania, PI2S2, GENIUS: Data & Grid Catalogs

Technical Training Catania, PI2S2, Contents Grid Portals technology GENIUS Portal Some Integrated Applications Future perspectives

Technical Training Catania, PI2S2, B L A S T This is a work supported in part by the LIBI and the BIOINFOGRID project.LIBI BIOINFOGRID

Technical Training Catania, PI2S2, What BLAST is ? BLAST (Basic Local Alignment Search Tool) provides a method for rapid searching of nucleotide and protein databases. The program compares nucleotide or protein sequences to sequence databases and calculates the statistical significance of matches.

Technical Training Catania, PI2S2, The home - The Services

Technical Training Catania, PI2S2, Bioinformatics databases This table is dynamically created take into account the databases published in the LFC Catalog.

Technical Training Catania, PI2S2, MULTI BLAST : input form /1 Upload the file with the FASTA sequences

Technical Training Catania, PI2S2, MULTI BLAST : submit Multi FASTA successfully submitted to WMProxy Inspect the status of the Collection

Technical Training Catania, PI2S2, MULTI BLAST : queue Retrieve the output of the Collection

Technical Training Catania, PI2S2, MULTI BLAST : Data Spooler View the output of each subjobs

Technical Training Catania, PI2S2, Considerations We have proposed a Grid infrastructure, based on a user-friendly interface, that ease the interact with the last release of gLite middleware and allow biologists to submit, in a transparent way regardless the complexity of the underlying infrastructure, a multi BLAST search composed by several FASTA sequences. At the moment the Grid does not give any advantage respect to the Blast Web portal for simple queries: the time needed to start a grid job is considerably longer then the time to execute the query on the web portal. The advantage comes if a user is interested in a bunch of queries: in this case the different queries can be subdivide between several jobs, and the answer to a multiple query can be obtained in the same time as a single query.

Technical Training Catania, PI2S2, R O S E T T A

Technical Training Catania, PI2S2, What ROSETTA does Proteins existing on Earth are only an infinitesimal fraction of the possible sequences – How the “few” extant proteins were produced and/or selected during prebiotic molecular evolution? – Do extant proteins have particular features which make them eligible for selection (e.g., thermodynamic, kinetic or other physical properties)? ROSETTA is a protein structure prediction method Prediction of the three-dimensional structure of never born proteins using the ROSETTA software

Technical Training Catania, PI2S2, The home – The Services Application available under “VO Services” for the VO GILDA.

Technical Training Catania, PI2S2, Create the dynamic ClassAD /1

Technical Training Catania, PI2S2, Submit ROSETTA to the Grid /1

Technical Training Catania, PI2S2, Submit ROSETTA to the Grid /2 Inspect the status of the Parametric Job

Technical Training Catania, PI2S2, Inspect the status /2

Technical Training Catania, PI2S2, Data Spooler /1

Technical Training Catania, PI2S2, UNOSAT - PROJECT

Technical Training Catania, PI2S2, What is UNOSAT The goal of UNOSAT is to make satellite images and geographic information easily accessible to the humanitarian community and to experts worldwide working to reduce disasters and plan sustainable development. To do this we acquire satellite images from all commercial providers. UNOSAT is a unique cooperation initiative between the UN, science and satellite industry that ensures low-cost and high quality solutions. UNOSAT provides services in the following areas: –Satellite imagery selection and procurement assistance –Image processing –Map production –Methodological guidance –Technical assistance –Training

Technical Training Catania, PI2S2, The UnoSat Integration

Technical Training Catania, PI2S2, UnoSat Submission

Technical Training Catania, PI2S2, Monitoring

Technical Training Catania, PI2S2, GetOutPut

Technical Training Catania, PI2S2, Contents Grid Portals technology GENIUS Portal Some Integrated Applications Future perspectives

Technical Training Catania, PI2S2, Future perspectives in Genius Portal Genius will integrate a workflow engine. We are integrating an authentication-applet to execute voms-proxy-init.. Genius Portlet will be standard JSR 168 compliant ASAP a new version of Genius…

Technical Training Catania, PI2S2, References NICE web-site EnginFrame Framework GENIUS Portal (Reference main site) GENIUS Repository at GENIUS based on gLite at ************************************************************************* GENIUS Installation GENIUS Repository at

Technical Training Catania, PI2S2, Questions???