E-science grid facility for Europe and Latin America The GENIUS Grid Portal Riccardo Bruno INFN Catania First EELA2 Grid School (E2GRIS1) Nov 2008, Itacuruçá (Brazil)
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Grid portal technology GENIUS/EnginFrame: new version 4.0 VOMS Proxy Init Service Grid Services Robot Certificates Summary and Conclusions Outline 2
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – A grid portal: why and how It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, cell phone). It can keep the same user interface to several back- ends. It must be redundantly “secure” at all levels: – 1) secure for web transactions, – 2) secure for user credentials, – 3) secure for user authentication, – 4) secure at VO/VOMS level. All available grid services must be incorporated in a logic way, just “one mouse click away”. Its layout must be easily understandable and user friendly.
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – A Grid Portal improves usability of Grids – Lowering end-user requirements for accessing the Grid – Hiding the complexity of data and job services management in the Grid A Grid Portal improves utilization of Grids – Making the Grid (r)evolution transparent to the end-user – Providing an appealing user-friendly Web interface – Enforcing Grid utilization policies Grid Portal Benefits
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Interactive Applications Intranet Clients Win LX UXMac Grid / Compute Farm Internal Users Batch Applications Storage and Data Grid Portal / Gateway Project Managers Client Apps Standard protocols Licenses Home Users The Grid Portal / Gateway
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Grid portal technology GENIUS/EnginFrame: new version 4.0 VOMS Proxy Init Service Grid Services Robot Certificates Summary and Conclusions Outline 6
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – What EnginFrame is ? 7 It’s a web based technology able to expose grid services to the GRID Infrastructure It allows organizations to provide application-oriented computing and data services It’s a GRID Gateway It semplify the development of web portals exposing services that can run over broad range of different Grid Infrastructures
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Spoolers HTML page Custom plugin Script Browser SDF XML EnginFrame Server HTML XSLT Grid Compute Farm Grid Compute Farm MetaFrame + NFuse MetaFrame + NFuse Application Server Application Server EnginFrame Agent Execute Service Req XML output Service Req User Authorize Groups, ACLs XML Layout XSL Service Submission EnginFrame Working Environment
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – gzip sample maximum medium none EF_SPOOLER_NAME="gzip $file” export EF_SPOOLER_NAME ${EF_ROOT}/plugins/lsf/bin/bsub -o output.txt gzip -$level \"$FILE\” Service example
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Who uses EnginFrame? Mechanical – Ferrari, Audi, BMW, FIAT Auto, Elasis, Magneti Marelli, P+Z, Swagelok, Toyota, TRW Manufacturing – Bridgestone, Procter & Gamble, Galileo Avionica Oil&Gas – Slavneft, Schlumberger, TOTAL, VNIIGaz Electronics – STMicroelectronics, Accent, SensorDynamics, Motorola Biotech – ENEA, EGEE LS community Telecom – Telecom Italia Research – INFN, ASSC, CCLRC, CERN, CILEA, CINECA, CNR, CNRS/IN2P3, ENEA, FzU, ICI, IFAE, ITEP, JSC G.G.M., KU Leuven, SSC-Russia, SDSC Education – Dresda University, Ferrara University, ITU, Messina University, Politecnico of Milan, Technische Universität Dresden, Trinity College Dublin, Salerno University, S- PACI 10
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS is a powerful Grid Portal that allows scientists to exploit Grid resources only using a conventional Web browser It has been built on top of the EnginFrame framework It’s a gateway to European EGEE Project middle- ware It allows to expose gLite-enabled applications via Web-browser as well as Web Services What GENIUS is ? 11
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS architecture Globus middleware Compute resources EGEE middleware LCG-2 / gLite Local Data Distributed Data Classic GENIUS Authentication – ACL management Data Management & Virtualization General XML Application Kits VO n - XML Application Kit VO 1 - XML Application Kit Monitoring & Accounting VNC remote Desktop over SSL X509 Proxy w/ VOMS extensions End users Presentation engine WSDL/SOAP 3rd party Apps HTTP RSS Clients JSR168 Portlet Containers Portlet GW WS GW RSS GW
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Reference Web Site: 13
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Grid portal technology GENIUS/EnginFrame: new version 4.0 VOMS Proxy Init Service Grid Services Robot Certificates Summary and Conclusions Outline 14
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Login…
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – VOMS Proxy Init Service A Text Code is required to start the VOMS Proxy Applet for the proxy initialization The Java plugin or higher is mandatory required. 16
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – VOMS Proxy Init Service Jointly developed by NICE and INFN Catania 17
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – VOMS Proxy Init Service
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – VOMS Proxy Init Service
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – VOMS Proxy Init Service
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – VOMS Proxy Init Service
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – VOMS Proxy Init Service Now the user is authenticated on gLite middleware 22
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Grid portal technology GENIUS/EnginFrame: new version 4.0 VOMS Proxy Init Service Grid Services Robot Certificates Summary and Conclusions Outline 23
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: files management
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: files management Multiple Action in a Single Service
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Multiple File Download (MFD) 26
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Multiple File Upload (MFU) 27
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Grid Preferences
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Job Submission
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Job Submission
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Job Submission
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Job(s) Queue
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Job Retrieving
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Data Spooler
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Tight VNC GENIUS: Interactive Services
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Local Browse on laptop Remote Browse on UI (GENIUS Server) Extended Remote File Browse on LFC Catalog GENIUS: Data Management
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Data Management
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Submit Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Submit Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Submit Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Submit Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Submit Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Submit Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS: Submit Workflow
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – All web transactions are executed under the Secure Socket Layer (SSL) via HTTPS The user must have an account on the User Interface When the user wants to interact with the file-system of the UI, he gets prompted for the username and password of the account on that machine All the glite functionalities are integrated in the portal and accessible only after the creation of the voms- proxy through the applet GENIUS: security infrastructure 52
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Grid portal technology GENIUS/EnginFrame: new version 4.0 VOMS Proxy Init Service Grid Services Robot Certificates Summary and Conclusions Outline 53
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Robot certificates 1.Starting from Feb also the Italian INFN CA will start to issue Robot Certificates. Thanks to these new certificates biologists will be able to access the grid sharing the certificate installed on the portal. 2.UK and NL CA are already issuing robot certificates 3. The decision of the INFN CA is a great success of the BioinfoGRID project
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Your identity: /C=IT/O=GILDA/OU=Robots/L=INFN Catania/CN=Robot:MrBayes - Giuseppe La Rocca Creating temporary proxy Done Contacting voms.ct.infn.it:15001 [/C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it ] "gilda" Done Creating proxy Done Your proxy is valid until Thu May 8 21:42: Robot certificates
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – In order to strong reduce the risks of having the portal certificate compromised and improve the security, the INFN CA has decided to issue this new certificate on board of the Aladdin eToken PRO smart card. – Each smart card can support several robot certificates: one for each application user wants to share with the other. – An user’s PIN is prompted every time user try to read the certificate on board of the smart card to generate a proxy.
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – GENIUS and robot certificates Admin User
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – User Tracking System (UTS)
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – User Tracking System (UTS)
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – User Tracking System (UTS)
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – User Tracking System (UTS)
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Grid portal technology GENIUS/EnginFrame: new version 4.0 VOMS Proxy Init Service Grid Services Robot Certificates Before to conclude some applications … Summary and Conclusions Outline 62
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – C O D E S A – 3 D This is a work supported in collaboration with Giuditta Lecca 1, Jawher Kerrou 2, Philippe Renard 3 Giuseppe La Rocca 4 and Roberto Barbera 4 1 CRS4, Cagliari (Italy) 2 INAT, Tunis (Tunisia) 3 CHYN, University of Neuchatel (Switzerland) 4 INFN, Catania (Italy) Presented at First EUMedGrid Project Review Madrid, Feb. - SPAIN
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – The CODESA-3D application CODESA-3D (COupled variable DEnsity and Saturation 3-Dimensional) is a software developed at CRS4 (Center for Advanced Studies, Research and Development in Sardinia - Its aims to study, taking into account detailed mathematical representations of physical, chemical and biological processes that govern water flow, saltwater intrusion in freshwater coastal aquifers.
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – The Korba case-study (Tunisia) Extraction rates and Recharge Map
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Integration & results
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – References “Sustainable management of groundwater exploitation using Monte Carlo simulation of seawater intrusion in Korba aquifer (Tunisia)” – Mr.KERROU, J. – Dr. LECCA, G. – Prof. RENARD, P. – Dr. LA ROCCA, G. – Prof. BARBERA, R. – EGEE User Forum March Internation Science Grid This Week (ISGTW) – - March, 2007http://
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – What is BLAST ? BLAST (Basic Local Alignment Search Tool) is an algorithm used to compare biological sequences, such as the amino-acid of different proteins or the nucleotides of DNA sequences. The program requires a query sequence (also called target sequence) and a database. Its identifies all the sub-sequences of the target query that are similar to the sub-sequences in the database.
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), –
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Bioinformatics databases This table is dynamically created taking into account the databases published in the LFC Catalog.
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – MULTI BLAST : input form /1 Upload the file with the FASTA sequences
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – MULTI BLAST : input form /2
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – MULTI BLAST : submit Multi FASTA successfully submitted to WMProxy Inspect the status of the Collection
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – MULTI BLAST : queue Retrieve the output of the Collection
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – MULTI BLAST : Data Spooler View the output of each subjobs
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – MULTI BLAST : LFC Catalog Show Details Download & View
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Click here to inspect a typical output file produced by BLAST during the computationhere The results
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – References “Muli BLAST on Demonstrator: an easy way to run BLAST in a GRID Infrastructure” – AIFTIMIEI, C. – CAROTA, L. – DE FILIPPIS, N. – DONVITO, G. – FALZONE, A – PIERRO, A. – TULIPANO, A, – LA ROCCA, G. – VERLATO, M. – Prof. BARBERA, R. – Prof. MAGGI, G.P. CAPI2006 BIOCOMPUTING – Milan 2006.
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – A R C H A E O C L I M A TO L O G Y This is a work supported in collaboration with Pier Giovanni PELFER University of Florence - ITALY Presented at First EUMedGrid Project Review Madrid, Feb. - SPAIN
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – The Mediterranean Region at the end of the urban revolution ArchaeoGrid aims to investigate the paleoclimate situation in the Mediterranean Area between XVIII centuries B.C. This kind of studies are made available, within EUMEDGRID, using a metereological modelling software called MM5. It allows to create complex atmospheric simulations and simulate weather evolution.
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – The result The MM5 program, thanks to the description of the environment, elaborates the meteorological data and generate the forecast
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Grid portal technology GENIUS/EnginFrame: new version 4.0 VOMS Proxy Init Service Robot Certificates Summary and Conclusions 82
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – Summary and Conclusions GENIUS offers the following advantages: it is a complete production-ready environment which combines the concepts of “user portal” and “science portal”; absolutely no client software needs to be installed on the user’s workstation apart from the web browser with its usual plug-ins like Java (at least JRE or higher); it provides a new unique tool to authorize users, in a very strong secure way, into the grid environment with or without VOMS support as well, easy to use; it includes support for both single and composite jobs (including DAG’s); interactive analysis and web access to personal spooling areas are possible; environment and settings customizable for the users; security for data management and sessions. 83
Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), – References NICE web-site EnginFrame Framework GENIUS Portal GENIUS Repository at GENIUS based on gLite at GENIUS Installation GENIUS Repository at Write an message to italy.com or for an account request to download the GENIUS