E-science grid facility for Europe and Latin America The GENIUS Grid Portal Riccardo Bruno INFN Catania

www.eu-eela.org E-science grid facility for Europe and Latin America The GENIUS Grid Portal Riccardo Bruno INFN Catania riccardo.bruno@ct.infn.it riccardo.bruno@ct.infn.it First EELA2 Grid School (E2GRIS1) 02-15 Nov 2008, Itacuruçá (Brazil)

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Grid portal technology GENIUS/EnginFrame: new version 4.0 VOMS Proxy Init Service Grid Services Robot Certificates Summary and Conclusions Outline 2

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 3 A grid portal: why and how It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, cell phone). It can keep the same user interface to several back- ends. It must be redundantly “secure” at all levels: – 1) secure for web transactions, – 2) secure for user credentials, – 3) secure for user authentication, – 4) secure at VO/VOMS level. All available grid services must be incorporated in a logic way, just “one mouse click away”. Its layout must be easily understandable and user friendly.

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 A Grid Portal improves usability of Grids – Lowering end-user requirements for accessing the Grid – Hiding the complexity of data and job services management in the Grid A Grid Portal improves utilization of Grids – Making the Grid (r)evolution transparent to the end-user – Providing an appealing user-friendly Web interface – Enforcing Grid utilization policies Grid Portal Benefits

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Interactive Applications Intranet Clients Win LX UXMac Grid / Compute Farm Internal Users Batch Applications Storage and Data Grid Portal / Gateway Project Managers Client Apps Standard protocols Licenses Home Users The Grid Portal / Gateway

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 What EnginFrame is ? 7 It’s a web based technology able to expose grid services to the GRID Infrastructure It allows organizations to provide application-oriented computing and data services It’s a GRID Gateway It semplify the development of web portals exposing services that can run over broad range of different Grid Infrastructures

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Spoolers HTML page Custom plugin Script Browser SDF XML EnginFrame Server HTML XSLT Grid Compute Farm Grid Compute Farm MetaFrame + NFuse MetaFrame + NFuse Application Server Application Server EnginFrame Agent Execute Service Req XML output Service Req User Authorize Groups, ACLs XML Layout XSL Service Submission EnginFrame Working Environment

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 gzip sample maximum medium none EF_SPOOLER_NAME="gzip $file” export EF_SPOOLER_NAME ${EF_ROOT}/plugins/lsf/bin/bsub -o output.txt gzip -$level \"$FILE\” Service example

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Who uses EnginFrame? Mechanical – Ferrari, Audi, BMW, FIAT Auto, Elasis, Magneti Marelli, P+Z, Swagelok, Toyota, TRW Manufacturing – Bridgestone, Procter & Gamble, Galileo Avionica Oil&Gas – Slavneft, Schlumberger, TOTAL, VNIIGaz Electronics – STMicroelectronics, Accent, SensorDynamics, Motorola Biotech – ENEA, EGEE LS community Telecom – Telecom Italia Research – INFN, ASSC, CCLRC, CERN, CILEA, CINECA, CNR, CNRS/IN2P3, ENEA, FzU, ICI, IFAE, ITEP, JSC G.G.M., KU Leuven, SSC-Russia, SDSC Education – Dresda University, Ferrara University, ITU, Messina University, Politecnico of Milan, Technische Universität Dresden, Trinity College Dublin, Salerno University, S- PACI 10

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 GENIUS is a powerful Grid Portal that allows scientists to exploit Grid resources only using a conventional Web browser It has been built on top of the EnginFrame framework It’s a gateway to European EGEE Project middleware It allows to expose gLite-enabled applications via Web-browser as well as Web Services What GENIUS is ? 11

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 GENIUS architecture Globus middleware Compute resources EGEE middleware LCG-2 / gLite Local Data Distributed Data Classic GENIUS Authentication – ACL management Data Management & Virtualization General XML Application Kits VO n - XML Application Kit VO 1 - XML Application Kit Monitoring & Accounting VNC remote Desktop over SSL X509 Proxy w/ VOMS extensions End users Presentation engine WSDL/SOAP 3rd party Apps HTTP RSS Clients JSR168 Portlet Containers Portlet GW WS GW RSS GW

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Reference Web Site: https://genius.ct.infn.it 13

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Login…

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 VOMS Proxy Init Service A Text Code is required to start the VOMS Proxy Applet for the proxy initialization The Java plugin 1.6.0 or higher is mandatory required. 16

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 VOMS Proxy Init Service Jointly developed by NICE and INFN Catania 17

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 VOMS Proxy Init Service

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 VOMS Proxy Init Service Now the user is authenticated on gLite middleware 22

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 GENIUS: files management

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 GENIUS: files management Multiple Action in a Single Service

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Multiple File Download (MFD) 26

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Multiple File Upload (MFU) 27

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 GENIUS: Grid Preferences

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 29 GENIUS: Job Submission

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 GENIUS: Job(s) Queue

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 GENIUS: Job Retrieving

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 GENIUS: Data Spooler

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Tight VNC GENIUS: Interactive Services

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 36 Local Browse on laptop Remote Browse on UI (GENIUS Server) Extended Remote File Browse on LFC Catalog GENIUS: Data Management

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 37 GENIUS: Data Management

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 38 GENIUS: Workflow

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 45 GENIUS: Submit Workflow

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 All web transactions are executed under the Secure Socket Layer (SSL) via HTTPS The user must have an account on the User Interface When the user wants to interact with the file-system of the UI, he gets prompted for the username and password of the account on that machine All the glite functionalities are integrated in the portal and accessible only after the creation of the voms- proxy through the applet GENIUS: security infrastructure 52

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Robot certificates 1.Starting from Feb. 2008 also the Italian INFN CA will start to issue Robot Certificates. Thanks to these new certificates biologists will be able to access the grid sharing the certificate installed on the portal. 2.UK and NL CA are already issuing robot certificates 3. The decision of the INFN CA is a great success of the BioinfoGRID project

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Your identity: /C=IT/O=GILDA/OU=Robots/L=INFN Catania/CN=Robot:MrBayes - Giuseppe La Rocca Creating temporary proxy................................ Done Contacting voms.ct.infn.it:15001 [/C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it ] "gilda" Done Creating proxy............................................................................... Done Your proxy is valid until Thu May 8 21:42:05 2008 Robot certificates

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 In order to strong reduce the risks of having the portal certificate compromised and improve the security, the INFN CA has decided to issue this new certificate on board of the Aladdin eToken PRO smart card. – http://www.aladdin.com/etoken/ http://www.aladdin.com/etoken/ Each smart card can support several robot certificates: one for each application user wants to share with the other. – An user’s PIN is prompted every time user try to read the certificate on board of the smart card to generate a proxy.

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 GENIUS and robot certificates Admin User

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 User Tracking System (UTS)

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Grid portal technology GENIUS/EnginFrame: new version 4.0 VOMS Proxy Init Service Grid Services Robot Certificates Before to conclude some applications … Summary and Conclusions Outline 62

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 63 C O D E S A – 3 D This is a work supported in collaboration with Giuditta Lecca 1, Jawher Kerrou 2, Philippe Renard 3 Giuseppe La Rocca 4 and Roberto Barbera 4 1 CRS4, Cagliari (Italy) 2 INAT, Tunis (Tunisia) 3 CHYN, University of Neuchatel (Switzerland) 4 INFN, Catania (Italy) Presented at First EUMedGrid Project Review Madrid, 27-28 Feb. - SPAIN

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 64 The CODESA-3D application CODESA-3D (COupled variable DEnsity and Saturation 3-Dimensional) is a software developed at CRS4 (Center for Advanced Studies, Research and Development in Sardinia - http://www.crs4.it/).http://www.crs4.it/ Its aims to study, taking into account detailed mathematical representations of physical, chemical and biological processes that govern water flow, saltwater intrusion in freshwater coastal aquifers.

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 65 The Korba case-study (Tunisia) Extraction rates and Recharge Map

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 66 Integration & results

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 67 References “Sustainable management of groundwater exploitation using Monte Carlo simulation of seawater intrusion in Korba aquifer (Tunisia)” – Mr.KERROU, J. – Dr. LECCA, G. – Prof. RENARD, P. – Dr. LA ROCCA, G. – Prof. BARBERA, R. – EGEE User Forum 01- 03 March 2006. Internation Science Grid This Week (ISGTW) – http://www.isgtw.org/?pid=1000341 - March, 2007http://www.isgtw.org/?pid=1000341

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 68 What is BLAST ? BLAST (Basic Local Alignment Search Tool) is an algorithm used to compare biological sequences, such as the amino-acid of different proteins or the nucleotides of DNA sequences. The program requires a query sequence (also called target sequence) and a database. Its identifies all the sub-sequences of the target query that are similar to the sub-sequences in the database.

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 69

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 70 Bioinformatics databases This table is dynamically created taking into account the databases published in the LFC Catalog.

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 71 MULTI BLAST : input form /1 Upload the file with the FASTA sequences

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 72 MULTI BLAST : input form /2

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 73 MULTI BLAST : submit Multi FASTA successfully submitted to WMProxy Inspect the status of the Collection

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 74 MULTI BLAST : queue Retrieve the output of the Collection

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 75 MULTI BLAST : Data Spooler View the output of each subjobs

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 76 MULTI BLAST : LFC Catalog Show Details Download & View

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 77 Click here to inspect a typical output file produced by BLAST during the computationhere The results

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 78 References “Muli BLAST on Demonstrator: an easy way to run BLAST in a GRID Infrastructure” – AIFTIMIEI, C. – CAROTA, L. – DE FILIPPIS, N. – DONVITO, G. – FALZONE, A – PIERRO, A. – TULIPANO, A, – LA ROCCA, G. – VERLATO, M. – Prof. BARBERA, R. – Prof. MAGGI, G.P. CAPI2006 BIOCOMPUTING – Milan 2006.

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 79 A R C H A E O C L I M A TO L O G Y This is a work supported in collaboration with Pier Giovanni PELFER (pelfer@fi.infn.it) University of Florence - ITALY Presented at First EUMedGrid Project Review Madrid, 27-28 Feb. - SPAIN

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 80 The Mediterranean Region at the end of the urban revolution ArchaeoGrid aims to investigate the paleoclimate situation in the Mediterranean Area between XVIII centuries B.C. This kind of studies are made available, within EUMEDGRID, using a metereological modelling software called MM5. It allows to create complex atmospheric simulations and simulate weather evolution.

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 81 The result The MM5 program, thanks to the description of the environment, elaborates the meteorological data and generate the forecast

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Grid portal technology GENIUS/EnginFrame: new version 4.0 VOMS Proxy Init Service Robot Certificates Summary and Conclusions 82

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 Summary and Conclusions GENIUS offers the following advantages: it is a complete production-ready environment which combines the concepts of “user portal” and “science portal”; absolutely no client software needs to be installed on the user’s workstation apart from the web browser with its usual plug-ins like Java (at least JRE 1.6.0 or higher); it provides a new unique tool to authorize users, in a very strong secure way, into the grid environment with or without VOMS support as well, easy to use; it includes support for both single and composite jobs (including DAG’s); interactive analysis and web access to personal spooling areas are possible; environment and settings customizable for the users; security for data management and sessions. 83

www.eu-eela.eu Itacuruçá (Brazil), First EELA2 Grid School (E2GRIS1), 02.11.2008 – 15.09.2008 References NICE web-site http://www.nice-italy.comhttp://www.nice-italy.com EnginFrame Framework http://www.enginframe.comhttp://www.enginframe.com GENIUS Portal https://genius.ct.infn.ithttps://genius.ct.infn.it GENIUS Repository at https://geniuscvs.ct.infn.ithttps://geniuscvs.ct.infn.it GENIUS based on gLite at https://glite-tutor2.ct.infn.ithttps://glite-tutor2.ct.infn.it GENIUS Installation GENIUS Repository at https://geniuscvs.ct.infn.ithttps://geniuscvs.ct.infn.it Write an email message to alberto.falzone@nice- italy.com or nicola.venuti@nice-italy.com for an account request to download the GENIUS packagealberto.falzone@nice- italy.comnicola.venuti@nice-italy.com

E-science grid facility for Europe and Latin America The GENIUS Grid Portal Riccardo Bruno INFN Catania

Similar presentations

Presentation on theme: "E-science grid facility for Europe and Latin America The GENIUS Grid Portal Riccardo Bruno INFN Catania"— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

E-science grid facility for Europe and Latin America The GENIUS Grid Portal Riccardo Bruno INFN Catania

Similar presentations

Presentation on theme: "E-science grid facility for Europe and Latin America The GENIUS Grid Portal Riccardo Bruno INFN Catania"— Presentation transcript:

Similar presentations

About project

Feedback