FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GENIUS Grid portal Moisés Hernández Duarte UNAM-FES Cuautitlán Tutorial en grid, visualization and high performance calculation Mexico City, October 23-26, 2007 Based on Luciano Díaz Fourth EELA Tutorial presentation

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 2 GRID computing vision Heterogeneous computing and storage resources distributed worldwide can be linked together and connected by an intelligent series of services, the GRID middleware and behave as a single machine in a transparent way GRIDMIDDLEWAREGRIDMIDDLEWARE Visual ising Work statio n Mobile Acces s Supercomputer PC-Cluster Data-storage, Sensors, Experiments Internet, networks

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 3 Easy and trasparent access to the GRID services Most of the services provided by the middleware are currently exposed to end users through more or less complex Command Line Interfaces (i.e. using text terminals) A generic user would like to access the GRID: –From all kind of network-connected devices (desktop PCs, laptops, PDA, smartphones, …) –From everywhere in the world (as for the WWW) –Independently of the Operating System –Without installing any special software package (it is needed just a web browser)

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 4 The GENIUS Portal Project At the beginning of 2002 the Italian INFN GRID Project started the GENIUS Portal Project in conjunction with the Italian web technology company NICE srl The present implementation of the GENIUS grid portal described here is carried out on the top of the gLite middleware services

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 5 GENIUS GRID portal features 1/2 It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, cell phone). The same user interface to several back-ends. All available grid services incorporated in a logic way, just “one mouse click away”. Layout easily understandable and user friendly.

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 6 GENIUS GRID portal features 2/2 Secure at all levels: –1) secure for web transactions –2) secure for user credentials –3) secure for user authentication –4) secure at VO level.

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 7 The transparent grid access StorageElement StorageElementStorageElement ReplicaCatalogue UI dis k ResourceBroker ComputeElementComputeElement VOcolleague VOcolleague

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 8 Applications on GENIUS

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 9 The Genius Home Page

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 10 GENIUS on PDA Home Page Services Remote file browsing Remote file inspection

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 11 GENIUS for cell phone

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 12 The GENIUS model OS & Net services Basic Services High level GRID middleware HEPBiomed Other apps Other apps Applications’ specific layer Other apps GLOBU S toolkit EDG/LCG architecture GENIUS web portal GENIUS ® (Grid Enabled web eNvironment for site Independent User job Submission) INFN/NICE srl collaboration

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 13 Main advantages Thanks to the GENIUS and EnginFrame (developed by the Italian Company NICE srl) user can Interact with files on the UI Send jobs to the Grid Manage the data belonging to the given Virtual Organization. Moreover: No needs of a particular Operating System and middle- ware running on the client side

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 14 GENIUS: The 3 Tiers model Apache EnginFrame GENIUS https+java/xml WEB Browser UI Loc al WS the Grid M/W+GSI 3-tier model

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 15 Security Services 1/2 In order to guarantee a secure access to the Grid, GENIUS has been implemented with a multi-layered security infrastructure. All web transactions are executed under the Secure Socket Layer (SSL) via HTTPS. The user has to have an account on the User Interface machine where GENIUS is running (either it is his personal workstation or the system manager of a trusted Grid testbed site has to know him)

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 16 Security Services 2/2 Grid authentication in GENIUS is currently based on the concept of user credentials delegation implemented with MyProxy When the user wants to interact with the file-system of the UI, performing operations with his files, he gets prompted for the username and password of the account on that machine.

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 17 Grid authentication UI Loc al WS MyProx y Server GENIU S Server (UI) grid-proxy-init myproxy-init any grid service myproxy-get-delegation output the Grid execution WEB Browser

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 18 How GRID authentication work From a “trusted” machine the user can, using the private key of his X.509 personal certificate, create a temporary certificate issuer (a myproxy) and store it, for a defined amount of time, on a MyProxy Server When the user asks the GENIUS portal to invoke a Grid service, the portal contacts the MyProxy Server and tries to get a temporary proxy certificate on the user’s behalf

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 19 Cont… If the life time of the myproxy is not expired, temporary user credentials are retrieved, the action is performed and the output is rendered back into the user’s web browser. So, the three-tier architecture of MyProxy’s credentials delegation avoids the private key of the user’s certificate to be sent over the network, avoiding a security hole.

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 20 More on security In order to increase the security as much as possible, usernames and passwords typed on the browser by the user are not saved anywhere. They are streamed under the HTTPS protocol and then destroyed. GENIUS logs automatically out all clients which have been left unattended (no action on the web browser) for more than 30 minutes in order to avoid unwanted accesses from non-authorized users

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 21 GENIUS main services File Services Job Submission Services Monitoring Data Services

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 22 Login on the UI

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 23 File Services: View/Edit

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 24 File Services: View/Edit

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 25 File Services: Copy/Rename

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 26 File Services: Delete Files/Dirs

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 27 File Services: Create a Dir

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 28 File Services: Upload TAR ball

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 29 File Services: Upload a file

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 30 File Services: Change permiss.

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 31 File Services: Show Environment

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 32 Proxy info: GRID Authentication

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 33 Infor on proxy

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 34 Info on MyProxy

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 35 Info on VOMS Proxy

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 36 Change OS Password

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 37 Logout

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 38 GENIUS main services File Services Job Submission Services Monitoring

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 39 Job Submission Services Using GENIUS job submission services, the user can seamlessly create a job and run it on the Grid. In particular, it is possible to: List the available Computing Elements (sites/queues) where a given job can run on Create a job and submit it to a Resource Broker (which can be selected by the user) or to a particular computing element Monitor the current status of a job Inspect on the fly the output of a job and save it both on the User Interface machine and on the local workstation.

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 40 Authentication with MyProxy

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 41 GRID Settings

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 42 Job Subm: JDL file selection

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 43 Job Subm: Ready to submit

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 44 Job Subm: Choosing the RB

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 45 Job successfully submitted

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 46 Inspecting the Job Queue Logging information by clicking on the Globus JobID

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 47 Logging information

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 48 Job status

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 49 Job completed successfully

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 50 Retrieving Job results 1/4

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 51 Retrieving Job results 2/4

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 52 Retrieving job results 3/4

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 53 Retrieving job results 4/4

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 54 List of available resources 1/2

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 55 List of available resources 2/2

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 56 GENIUS main services File Services Job Submission Services Monitoring Data Services

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 57 GRID Monitoring within GENIUS

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 58 GENIUS for PDA

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 59 GENIUS main services File Services Job Submission Services Monitoring Data Services

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 60 Publishing a local file 1/3

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 61 Publishing a local file 2/3

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 62 Publishing a local file 3/3

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 63 VO Services

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 64 VO Services

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 65 VO Services: Hadron Therapy

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 66 VO Services: Protein rendering

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 67 3D rendering with POVRay

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 68 Interactive Services: VNC terminal

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 69 DAG management: TRIANA project

Users Tutorial, Mexico City, 23-24, October 2007 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 70 Conclusions It is a complete environment which combines the concepts of “user portal” and “science portal” Absolutely no client software needs to be installed on the users workstation (apart from the web browser) It includes support for both single and composite jobs (DAGs) Interactive analysis and web access to personal spooling areas are possible