Il Portale GENIUS Alberto Falzone NICE srl Primo Tutorial TriGrid VL

Slides:



Advertisements
Similar presentations
CHEP 2000, Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, (*) work in collaboration.
Advertisements

Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.
1 CHEP 2000, Roberto Barbera Recent grid activities at INFN Catania (*) HEPiX/HEPNT 2002, Catania, (*) work in collaboration with.
CHEP 2000, Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, Università di Catania and INFN Catania - Italy ALICE.
EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Roberto Barbera EGEE NA4 Generic Applications coordinator.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GENIUS Grid portal Moisés Hernández.
EGEE is a project funded by the European Union under contract IST GENIUS and EnginFrame Roberto Barbera Univ. of Catania and INFN SEE-GRID.
Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.
CHEP 2000, Roberto Barbera Roberto Barbera (*) The GENIUS grid portal CHEP 2003, (*) work in collaboration with A. Falzone and.
CHEP 2000, Roberto Barbera Roberto Barbera (*) The GENIUS Grid Portal Portals & Portlets 2003, Edinburgh, (*) work in collaboration.
A Web 2.0 Portal for Teragrid Fugang Wang Gregor von Laszewski May 2009.
 Copyright NICE srl, 2006 New Ideas for Computing Environments EnginFrame as framework for Grid enabled Web portals on Industrial and research contexts.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America GENIUS server installation and configuration.
INFSO-RI Enabling Grids for E-sciencE The GENIUS Grid portal Tony Calanducci INFN Catania - Italy First Latin American Workshop.
EGEE is a project funded by the European Union under contract IST The GENIUS portal Roberto Barbera University of Catania and INFN SEE-GRID.
 Copyright NICE srl, 2006 New Ideas for Computing Environments The Grid Portal for Industry and Research Alberto Falzone, Andrea Rodolico NICE srl
CHEP 2000, Giuseppe Andronico Grid portal based data management for Lattice QCD data ACAT03, Tsukuba, work in collaboration with A.
23:48:11Service Oriented Cyberinfrastructure Lab, Grid Portals Fugang Wang April 29
E-science grid facility for Europe and Latin America The GENIUS Grid Portal Giuseppe LA ROCCA INFN Catania
IST E-infrastructure shared between Europe and Latin America The GILDA t-Infrastructure and the GENIUS portal Domenico Vicinanza,
Induction: Additional features of GENIUS 18 May Some additional features of GENIUS EGEE is funded by the European Union under contract IST
EGEE is a project funded by the European Union under contract IST The GENIUS portal Roberto Barbera University of Catania and INFN First Latinamerican.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GENIUS Grid Portal Roberto Barbera Univ.
09/02 ID099-1 September 9, 2002Grid Technology Panel Patrick Dreher Technical Panel Discussion: Progress in Developing a Web Services Data Analysis Grid.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
The GENIUS Portal Nicola Venuti – Livia Torterolo NICE srl Geneva, , 2nd Tutorial for Health e-Child Project New Ideas for Computing Environments.
Getting started DIRAC Project. Outline  DIRAC information system  Documentation sources  DIRAC users and groups  Registration with DIRAC  Getting.
E-infrastructure shared between Europe and Latin America GENIUS PORTAL Valeria Ardizzone INFN-Catania 1° EELA Grid School Itacuruçà Island, State of Rio.
Geneva, 2nd Tutorial for Health e-Child Project, Service creation in Genius Web Portal Nicola Venuti NICE srl Geneva, , 2nd.
EGEE is a project funded by the European Union under contract IST GENIUS and EnginFrame Roberto Barbera EGEE NA4 Generic Applications coordinator.
1 Grid2Win: porting of gLite middleware to Windows Dario Russo INFN Catania
Some comments on Portals and Grid Computing Environments PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics,
INFSO-RI Enabling Grids for E-sciencE GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
EGEE is a project funded by the European Union under contract IST GENIUS and GILDA: a status report Roberto Barbera NA4 Generic Applications.
Enabling Grids for E-sciencE gLite security pratical tutorial Dario Russo INFN Catania Catania,
Remote Api Tutorial How to call WS-PGRADE workflows from remote clients through the http protocol?
IST E-infrastructure shared between Europe and Latin America The GILDA t-Infrastructure and the GENIUS portal Christian Grunfeld,
FESR Consorzio COMETA - Progetto PI2S2 Il portale grid: GENIUS Alberto Falzone NICE srl Consorzio COMETA – Progetto PI2S2 Tutorial.
EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Guy Warner NeSC Training Team Induction to Grid Computing.
REST API to develop application for mobile devices Mario Torrisi Dipartimento di Fisica e Astronomia – Università degli Studi.
Antonio Fuentes RedIRIS Barcelona, 15 Abril 2008 The GENIUS Grid portal.
Enabling Grids for E-sciencE Portals and Workflows: GENIUS and TRIANA Alberto Falzone NICE srl Bioinfogrid Meeting Bari,
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
EGEE is a project funded by the European Union under contract IST The GENIUS portal Assaf Gottlieb University of Tel Aviv EGEE tutorial, Ra’anana,
FESR Trinacria Grid Virtual Laboratory Il portale GENIUS, EnginFrame e strumenti per il calcolo distribuito Alberto Falzone, Beppe Ugolotti.
EGEE is a project funded by the European Union under contract IST The GILDA Project and the GENIUS portal Roberto Barbera University of Catania.
FESR Trinacria Grid Virtual Laboratory Practical using WMProxy advanced job submission Emidio Giorgio INFN Catania.
Practical using C++ WMProxy API advanced job submission
Grid2Win Porting of gLite middleware to Windows XP platform
Introduction to GILDA testbed and Genius portal
Tamas Kiss University Of Westminster
MyProxy Server Installation
Roberto Barbera (a nome di Livia Torterolo)
Grid2Win: Porting of gLite middleware to Windows XP platform
The GENIUS portal Roberto Barbera University of Catania and INFN
Grid2Win: Porting of gLite middleware to Windows XP platform
CRC exercises Not happy with the way the document for testbed architecture is progressing More a collection of contributions from the mware groups rather.
Remote Api Tutorial How to call WS-PGRADE workflows from remote clients through the http protocol?
Grid2Win: Porting of gLite middleware to Windows XP platform
Patrick Dreher Research Scientist & Associate Director
The European DataGrid Project Team
GENIUS: A Portal for Computing Grids
EGEE Middleware: gLite Information Systems (IS)
The GENIUS portal and the GILDA t-Infrastructure
Grid Engine Diego Scardaci (INFN – Catania)
The GILDA t-Infrastructure and the GENIUS portal
Presentation transcript:

Il Portale GENIUS Alberto Falzone NICE srl Primo Tutorial TriGrid VL Catania, 14-15.03.2006

A grid portal: why and how It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, cell phone). It can keep the same user interface to several back- ends. It must be redundantly “secure” at all levels: 1) secure for web transactions, 2) secure for user credentials, 3) secure for user authentication, 4) secure at VO/VOMS level. All available grid services must be incorporated in a logic way, just “one mouse click away”. Its layout must be easily understandable and user friendly. Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

The Web-centric vision Clients Standard Web Browser Licenses & Data Grid / Compute Farm Interactive Apps Inter/Intranet Server(s) Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS architecture Portlet Contaiers 3rd party Apps RSS Clients JSR168 Portlet Contaiers WSDL/SOAP 3rd party Apps HTTP RSS Clients End users Classic GENIUS Portlet GW WS GW RSS GW VO n - XML Application Kit VO 1 - XML Presentation engine MyProxy auth. w/ VOMS extensions Authentication – ACL management VNC remote Desktop over SSL General XML Application Kits Monitoring & Accounting Data Management & Virtualization EGEE middleware LCG-2 / gLite Local Data Distributed Data Globus middleware Compute resources Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: new version Powered by EnginFrame 4.1 !! The Stack on the User Interface: Apache + Mod_JK2 ; Mod_SSL for secure encrypted connections ; Tomcat as servlets container ; EnginFrame 4.1 as core of 3-tier model Thanks to New EF 4.1 features, NOW GENIUS Portal can export its services in JSR168 as portlets! New Flexibility of EF 4.1 improves the ways to write the code for grid integrations: plugins as independent modules Improved virtualization of Remote File Browsing A power GridML has been created for Job details Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: how it works the Grid https+java/xml+rfb WEB Browser GENIUS 3-tier model https+java/xml+rfb WEB Browser GENIUS Apache + Tomcat Local WS EnginFrame the Grid M/W+GSI gLite UI Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

The GENIUS hourglass model Grid Enabled web eNvironment for site Independent User job Submission INFN / NICE Collaboration GENIUS web portal OS & Net services Basic Services High level GRID middleware ALICE ATLAS CMS LHCb Applications’ specific layer Other apps GLOBUS toolkit EGEE (LCG/gLite) architecture Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS Portal Reference Web Site: https://genius.ct.infn.it Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: files management SSL Encryption ! Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: files management OS authority Both authorities os and genius are distinct: we have services with differen authority! Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: files management Remote File Browser On the User Interface Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: files management Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: files management Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: files management <ef:service id="edit-file"> <ef:name>View/Edit a File</ef:name> <ef:info>With this service you may edit a file in your home directory. </ef:info> <ef:option id="filetoedit" label="Select File to View/Edit" type="rfb" base="${HOME}" target="@genius"/> <ef:action id="view" label="View"> $EF_ROOT/plugins/genius/bin/geniusgrid.sh view-file <ef:result type="text/html"/> </ef:action> <ef:action id="edit" label="Edit"> $EF_ROOT/plugins/genius/bin/geniusgrid.sh edit-file <ef:result type="text/xml"/> </ef:service> Multiple Action in a Single Service Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: files management HTML fragment for better grouping of options in a service, i.e. <table> Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Grid Authentication with Myproxy myproxy-get-delegation Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Grid authentication with MyProxy UI MyProxy Server grid-proxy-init myproxy-init Now, VOMS Extensions needed to run jobs on the GRID ( --voms <voms_vo_name>) myproxy-get-delegation GENIUS Server (UI) WEB Browser the Grid execution Local WS output any grid service Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: security Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: preferences Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: preferences Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: preferences Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Server List Management GENIUS: preferences Custom MyProxy Server List Management Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Job Submission Preferences are on the horinzontal bar after successful login to the Grid (under genius authority) Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Job Submission Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Job Submission Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Job Submission Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

EF XML Dialect sample: job-submit service <ef:service id="job-submit" authority="genius"> <ef:name>Job Submission</ef:name> <ef:info>Please, select a JDL file to submit. You may also choose a Resource Broker to connect to.<br/> </ef:info> <ef:option id="jdl_file" label="JDL File" type="rfb" target="jdl@genius" base="$HOME"/> <ef:action id="submit" label="Next"> $EF_ROOT/plugins/genius/bin/geniusgrid.sh job-submit-next <ef:result type="text/xml"/> </ef:action> </ef:service> <ef:service id="job-submit-next" authority="genius" hidden="true"> <ef:info>Now you may also choose a specific Computing Element for your job.<br/> <ef:option id="jdl_file" label="JDL File Selected" type="hidden"></ef:option> <ef:option id="computing_element" label="Specify the CE Resource" type="list"> </ef:option> <ef:action id="submit" label="Submit Job"> $EF_ROOT/plugins/genius/bin/geniusgrid.sh job-submit <ef:result type="text/html"/> Catania, Primo Tutorial TriGrid VL, 14-15.03.2006 28

GENIUS: Job Queue Code for Job Queue management rewritten using GridML tags Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GridML sample: job <grid:job-list type="lsf" xmlns:grid="http://www.enginframe.com/2000/GRID"> <grid:job type="lsf" id="4120"> <grid:owner>andrea</grid:owner> <grid:account>default</grid:account> <grid:status>DONE</grid:status> <grid:queue>priority</grid:queue> <grid:command>/usr/bin/spamc</grid:command> <grid:submission-time month="Jan" day="21" hour="23" minute="06" year="2005"/> <grid:submission-host>mail</grid:submission-host> <grid:submission-directory>$HOME</grid:submission-directory> <grid:execution-time month="Jan" day="21" hour="23" minute="06" year="2005"/> <grid:execution-host>mail</grid:execution-host> <grid:termination-time month="Jan" day="21" hour="23" minute="06" year="2005"/> <grid:total-cpu-usage>0.0</grid:total-cpu-usage> <grid:exit-code>0</grid:exit-code> </grid:job> </grid:job-list> Catania, Primo Tutorial TriGrid VL, 14-15.03.2006 30

GENIUS: Job Queue New Confirmation Message! Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Job Queue - Spooler After get-output operation on the grid, the user is redirected to the spooler temporary area, ready to download on laptop. The spooler management has been improved on EF 4.1 Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Job Queue - Spooler Actions can be performed as facilities in downloading operations! Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Job Queue - Spooler Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Integrated Tight VNC for the first time during early GENIUS GENIUS: Interactive Integrated Tight VNC for the first time during early GENIUS development! Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Interactive Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Data & Grid Catalogs Local Browse on laptop Remote Browse on UI (GENIUS Server) Extended Remote File Browse on Fireman/LFC Catalog Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Data & Grid Catalogs Extended Multiple Remote File Browsing on Catalog! Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Data & Grid Catalogs Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Data & Grid Catalogs The download process clones on EF Spooler the tree present on Catalog starting from root directory. Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Data & Grid Catalogs Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Data & Grid Catalogs Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS: Data & Grid Catalogs Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

DAG Jobs DAG job is a set of jobs where the input, output, or execution of one or more jobs depends on one or more other ones Dependencies are represented through Directed Acyclic Graphs, where the nodes are graphs, and the edges identify the dependencies nodeA nodeB nodeC NodeF nodeD Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

DAG Jobs [ type = "dag"; max_nodes_running = 4; nodes = [ nodeA = [ file ="nodes/nodeA.jdl" ; ]; nodeB = [ file ="nodes/nodeB.jdl" ; nodeC = [ file ="nodes/nodeC.jdl" ; nodeF = [ file ="nodes/nodeF.jdl"; dependencies = { {nodeA, nodeB}, {nodeA, nodeC},{nodeA, nodeF}, { {nodeB,nodeC,nodeF}, nodeD } } ; ] Node description could be done also here, instead of using separate file Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS & TRIANA Graphic Workflow Editor Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Sample App: PATSearch Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Sample App: PATSearch Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Sample App: PATSearch Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Sample App: PATSearch Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Sample App: PATSearch Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Sample App: PATSearch Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Sample App: PATSearch Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Sample App: PATSearch Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Sample App: CODESA-3D Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Sample App: CODESA-3D Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Sample App: CODESA-3D Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Sample App: CODESA-3D Final Output Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS Installation on UI GENIUS Repository at https://geniuscvs.ct.infn.it Write an email message to alberto.falzone@nice-italy.com for an account request to download the GENIUS package root@gridba1:/opt/genius \>./genius_installer.sh Performing the GENIUS Installation process, please wait. Adding efnobody user Please, maintain this user GENIUS/EnginFrame Portal installed under /opt/genius path. Please: 1. Copy your server certificate (public key) under /opt/genius/apache/conf/ssl.crt and and (private key) under /opt/genius/apache/conf/ssl.key 2. Replace the host certificate names in /opt/genius/apache/conf/ssl.conf (yourservercertificate), and in /opt/genius/etc/genius.conf files. 3. Copy the EnginFrame license key file you have obtained by NICE srl company with /opt/genius/enginframe/license/license.ef filename 4. Open on your iptables firewall the following TCP ports in INPUT: 443 (https), 5901:5999 and 7801:7900 ranges. 5. Please, start GENIUS Portal service with following command: /etc/init.d/genius start6. Now GENIUS Portal can be reached at https://gridba1.ba.infn.it GENIUS Team. root@gridba1:/opt/genius \> Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

GENIUS References GENIUS Portal https://genius.ct.infn.it (Reference main site) EnginFrame Framework http://www.enginframe.com GENIUS Repository at https://geniuscvs.ct.infn.it GENIUS based on gLite at https://glite-tutor.ct.infn.it Coordinator alberto.falzone@nice-italy.com Catania, Primo Tutorial TriGrid VL, 14-15.03.2006

Q&A Q & A Thanks for your attention! Catania, Primo Tutorial TriGrid VL, 14-15.03.2006