Copyright NICE srl, 2006 New Ideas for Computing Environments The Grid Portal for Industry and Research Alberto Falzone, Andrea Rodolico NICE srl
Copyright NICE srl, Contents EnginFrame: the Framework for Computing Portals/Gateways –Evolution from 3.2 to 4.1 version –Industrial adoption overview GENIUS: new features, improvements –The Changes in the backend and the stack on the gLite UI –New Features, Improvements –Management of User Security GENIUSphere –JSR168 compliance from GENIUS/EnginFrame –EnginFrame Portlets in GridSphere
Copyright NICE srl, A grid portal: why and how It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, cell phone). It can keep the same user interface to several back-ends. It must be redundantly “secure” at all levels: –1) secure for web transactions, –2) secure for user credentials, –3) secure for user authentication, –4) secure at VO/VOMS level. –5) secure in data management All available grid services must be incorporated in a logic way, just “one mouse click away”. Its layout must be easily understandable and user friendly.
Copyright NICE srl, Licenses & Data Grid / Compute Farm Interactive Apps Inter/Intranet Server(s) Clients Standard Web Technology The Grid Portal vision
Copyright NICE srl, 2005 Data Grid (AFS, SRB, …) Storage Compute Grid (Globus, LSF, SGE, …) Internal HW/SW On-demand HW/SW WSDL/SOAP 3rd party Apps HTTP RSS Clients JSR168 Portlet Containers Skins / Themes Authentication – ACL management Custom XML Application Kits Data Management & Virtualization ISV n - XML Application Kit ISV 1 - XML Application Kit Accounting / Billing GUI Virtualization Single-Sign-On EnginFrame as Grid Gateway End users Presentation engine Portlet GW WS GW RSS GW COTS WF manager Workflows
Copyright NICE srl, 2005 EnginFrame evolution 1.x - LAN Integration (1998) Unix-Windows integration for simplified parallel and distributed computing 2.x - WAN MetaComputing interface (1999) Standards convergence, dynamic contents management 3.x - Computing Portal ( ) Web architecture, JS independence, Globus integration 3.5 – Enterprise Grid Portal (2004) Fault tolerance, Auth delegation, Authorization 4.x – Grid Gateway (2005) WS-I compliancy, user mapping, enhanced Data management, RSS notification, JSR168 portlet gateway
Copyright NICE srl, 2005 Flexible Input data access Client-side data –HTTP(S) data transfer –Single/multiple upload –Progress bars for large file tracking Server-side data –Standards-based remote navigation –Single-multiple selections –Flexible navigation sources Support for Windows, Linux and UNIX browsers
Copyright NICE srl, 2005 Comprehensive Output data management File management –Flexible MIME type detection –Single / multiple download –Zip, tar, delete and other actions Progress monitoring –“tail –f” streaming download –Stdout/stderr display –Can be extended with custom progress reporting Flexible data life-cycle management
Copyright NICE srl, 2005 ACL management Authorization system End users ServicesOption setsField contentsXML output
Copyright NICE srl, 2005 The Authorization Framework Authorization System is aimed to authorize user accesses to resources –allowing or denying operations –according to a set of predefined policies. Actor concept abstracts users. An actor can represent –single user –group of users EnginFrame resources are: –folders –services –service options –service action –service output Authorization policies are defined by Access Control Lists
Copyright NICE srl, 2005 WebServices gateway The Grid Gateway Service discoveryService execution Flow monitoringData retrieval Presentation layer WS Client
Copyright NICE srl, 2005 Client Reference Implementation Software Bundle It is possible to request the EF Web Services Java Client Reference Implementation from The Java Client Reference Implementation software bundle includes –Java stubs classes –Java client layer: client + utility classes –Required Java libraries: Axis, Jakarta-httpclient –Javadoc of the client API –Client examples with sources Implementation for other languages (.NET, Phyton, Perl) are also available
Copyright NICE srl, 2005 Who uses EnginFrame? Mechanical –Ferrari, Audi, BMW, FIAT Auto, Delphi, Elasis, Magneti Marelli, P+Z, Swagelok, Toyota, TRW Manufacturing –Bridgestone, Procter & Gamble, Galileo Avionica, Pirelli Oil&Gas –Slavneft, Schlumberger, TOTAL, VNIIGaz Electronics –STMicroelectronics, Accent, SensorDynamics, Motorola Others –Telecom Italia Research –INFN, ASSC, CCLRC, CERN, CILEA, CINECA, CNR, CNRS/IN2P3, ENEA, FzU, ICI, IFAE, ITEP, JSC G.G.M., KU Leuven, SSC-Russia, SDSC Education –Dresda University, Ferrara University, ITU, Messina University, Politecnico of Milan, Technische Universität Dresden, Trinity College Dublin, Salerno University, S-PACI
Copyright NICE srl, 2005 Corporate ASPs
Copyright NICE srl, 2005 E-Design collaboration Black-box for EDA simulation
Copyright NICE srl, 2005 HPC demo-center & ASPhttp://
Copyright NICE srl, 2005 Application integrations
Copyright NICE srl, 2005 How they look like
Copyright NICE srl, D preview integration
Copyright NICE srl, 2005 Portal to multiple Grids
Copyright NICE srl, Contents EnginFrame: the Framework for Computing Portals/Gateways –Evolution from 3.2 to 4.1 version –Industrial adoption overview GENIUS: new features, improvements –The Changes in the backend and the stack on the gLite UI –New Features, Improvements –Management of User Security GENIUSphere –JSR168 compliance from GENIUS/EnginFrame –EnginFrame Portlets in GridSphere
Copyright NICE srl, GENIUS: new version Powered by EnginFrame 4.1 !! The Stack on the User Interface: –Apache + Mod_JK2 ; –Mod_SSL for secure encrypted connections ; –Tomcat as servlets container ; –EnginFrame as core of 3-tier model Thanks to New EF features, NOW GENIUS Portal can export its services in JSR168 as portlets! New Flexibility of EF improves the ways to write the code for grid integrations: plugins as independent modules Improved virtualization of Remote File Browsing A power GridML has been created for Job details Available the MyProxy Applet for MyProxy Inizialization!
Copyright NICE srl, 2005 Globus middleware Compute resources EGEE middleware LCG-2 / gLite Local Data Distributed Data WSDL/SOAP 3rd party Apps HTTP RSS Clients JSR168 Portlet Contaiers Classic GENIUS Authentication – ACL management General XML Application Kits Data Management & Virtualization VO n - XML Application Kit VO 1 - XML Application Kit Monitoring & Accounting VNC remote Desktop over SSL MyProxy auth. w/ VOMS extensions GENIUS architecture End users Presentation engine Portlet GW WS GW RSS GW
Copyright NICE srl, The GENIUS hourglass model OS & Net services Basic Services High level GRID middleware ALICEATLASCMSLHCb Applications’ specific layer Other apps GLOBUS toolkit EGEE (LCG/gLite) architecture GENIUS web portal GENIUS Grid Enabled web eNvironment for site Independent User job Submission INFN / NICE Collaboration
Copyright NICE srl, GENIUS: layout restyling
Copyright NICE srl, GENIUS: files management Remote File Browser On the User Interface
Copyright NICE srl, GENIUS: files management Multiple Action in a Single Service View/Edit a File With this service you may edit a file in your home directory. <ef:option id="filetoedit" label="Select File to View/Edit" type="rfb" base="${HOME}" $EF_ROOT/plugins/genius/bin/geniusgrid.sh view-file $EF_ROOT/plugins/genius/bin/geniusgrid.sh edit-file
Copyright NICE srl, GENIUS: Grid Authentication with Myproxy myproxy-get-delegation
Copyright NICE srl, GENIUS: security Loaded on laptop or local WS! GILDA Collaboration: Thanks to the contribute of Valeria Ardizzone
Copyright NICE srl, GENIUS: security
Copyright NICE srl, GENIUS: preferences
Copyright NICE srl, GENIUS: Graphic Workflow Editor (Integration with TRIANA from GridLab Project)
Copyright NICE srl, GENIUS: Job Queue Code for Job Queue management rewritten using GridML tags
Copyright NICE srl, 2005 GridML sample: job andrea default DONE priority /usr/bin/spamc mail $HOME mail 0.0 0
Copyright NICE srl, GENIUS: Job Queue New Confirmation Message!
Copyright NICE srl, GENIUS: Job Queue - Spooler Actions can be performed as facilities in downloading operations!
Copyright NICE srl, Contents EnginFrame: the Framework for Computing Portals/Gateways –Evolution from 3.2 to 4.1 version –Industrial adoption overview GENIUS: new features, improvements –The Changes in the backend and the stack on the gLite UI –New Features, Improvements –Management of User Security GENIUSphere –JSR168 compliance from GENIUS/EnginFrame –EnginFrame Portlets in GridSphere
Copyright NICE srl, GENIUSphere: How it works GENIUS Server (UI) GridSphere portlet container + EF Portlets https + genius auth WebServices Output Instance of JSR168 portlets Every Genius Service can be considered as a singol atom to build a specific custom portal based on a portlet container like GridSphere that can dialog with the EGEE Grid Middleware !
Copyright NICE srl, GENIUSphere : files
Copyright NICE srl, GENIUSphere: files Files on the User Interface, where GENIUS is running!
Copyright NICE srl, GENIUSphere: files
Copyright NICE srl, GENIUSphere: security
Copyright NICE srl, GENIUSphere: Accounting
Copyright NICE srl, GENIUSphere: Jobs
Copyright NICE srl, GENIUSphere: Jobs
Copyright NICE srl, GENIUSphere: Jobs
Copyright NICE srl, GENIUSphere: Jobs
Copyright NICE srl, GENIUSphere: Data - Navigate
Copyright NICE srl, 2005 Grid Gateway User Group proposal Open community for GENIUS and EnginFrame plugin developers –Info forum on major happenings in the Grid Gateway arena –Blog / newsgroup for technical discussions Repository for portlet / plug-in developers –Industrial plug-ins for EnginFrame –Open source plug-ins for GENIUS –Other contributed components (e.g. GridSphere portlets, etc.) Volunteers are welcome! –Please contact:
Copyright NICE srl, Thanks for your attention!Q&A