Enabling Grids for E-sciencE GENIUS and EnginFrame: A successful EGEE technology transfer Ing. Beppe Ugolotti NICE srl The EGEE Industry Day Conference Parigi, LPNHE
Enabling Grids for E-sciencE Contents NICE Grids & Grid Portals Cases Histories Future Trends
Enabling Grids for E-sciencE NICE Expertise in Grid deployment Expertise in Grid deployment – European company with 10 years experience with enterprise Grid solutions – Comprehensive professional service offering for commercial and EGEE middleware Core business: the Global Grid Gateway Core business: the Global Grid Gateway – EnginFrame & GENIUS Grid Portal product line – VAR channels with worldwide coverage for implementation and support (incl. industry leader Platform Computing) Other relevant competencies Other relevant competencies – Server-based computing
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Some References Mechanical −Ferrari, Audi, BMW, FIAT Auto, Delphi, Elasis, Magneti Marelli, P+Z, Swagelok, Toyota, TRW Manufacturing −Bridgestone, Procter & Gamble, Galileo Avionica Oil&Gas −Slavneft, Schlumberger, TOTAL, VNIIGaz Electronics −STMicroelectronics, Accent, SensorDynamics, Motorola Biotech −ENEA, EGEE LS community Telecom – Telecom Italia Research – INFN, ASSC, CCLRC, CERN, CILEA, CINECA, CNR, CNRS/IN2P3, ENEA, FzU, ICI, IFAE, ITEP, JSC G.G.M., KU Leuven, SSC-Russia, SDSC Education – Dresda University, Ferrara University, ITU, Messina University, Politecnico of Milan, Technische Universität Dresden, Trinity College Dublin, Salerno University, S-PACI,IHEP Cina,
Enabling Grids for E-sciencE Contents NICE Grids & Grid Portals Cases Histories Future Trends
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, The “ Grid Enviroment “ Grid middleware API, Web Services (WSRF, WS-I, …) API, Web Services (WSRF, WS-I, …) OS Heterogeneous Heterogeneous Virtualization Virtualization Hardware Heterogeneous Heterogeneous Supercomputers, clusters, workstations Supercomputers, clusters, workstations Networks LAN, WAN, high speed networks, firewalls LAN, WAN, high speed networks, firewalls Schedulers Resource sharing policies, SLA Resource sharing policies, SLA Modeling, simulation, data analysis, algorithms Legacy, grid-enabled Legacy, grid-enabled Batch, interactive Batch, interactive Commercial, open source Commercial, open source Flows Flows Data Files, databases Files, databases Security AAA AAA IP protection IP protection People Collaboration, distributed teams Collaboration, distributed teams Project-driven allocation, reservation Project-driven allocation, reservation Costs sharing Costs sharing
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Applications (commercial) Grid Components Application Gridification Data Management CPU Workload Management License Management Multi-site Management Grid Portal Security / Authorization ROI Analysis - BI Flow/Process Management
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Multi-site orchestration
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, The Grid Portal vision Licenses & Data Grid / Compute Farm Interactive Apps Inter/Intranet Server(s) Clients Standard Web Technology
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, GENIUS - EGEE Grid Portal
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Globus middleware Compute resources EGEE middleware LCG-2 / gLite Local Data Distributed Data WSDL/SOAP 3rd party Apps HTTP RSS Clients JSR168 Portlet Contaiers Classic GENIUS Authentication – ACL management General XML Application Kits Data Management & Virtualization VO n - XML Application Kit VO 1 - XML Application Kit Monitoring & Accounting VNC remote Desktop over SSL MyProxy auth. w/ VOMS extensions GENIUS architecture End users Presentation engine Portlet GW WS GW RSS GW
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, GENIUSphere: Data - Navigate
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Data Grid (AFS, SRB, …) Storage Compute Grid (Globus, LSF, SGE, …) Internal HW/SW On-demand HW/SW WSDL/SOAP 3rd party Apps HTTP RSS Clients JSR168 Portlet Containers Skins / Themes Authentication – ACL management Custom XML Application Kits Data Management & Virtualization ISV n - XML Application Kit ISV 1 - XML Application Kit Accounting / Billing GUI Virtualization Single-Sign-On EnginFrame as Grid Gateway End users Presentation engine Portlet GW WS GW RSS GW COTS WF manager Workflows
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Contents NICE Grids & Grid Portals Cases Histories Future Trends
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Portals in Oil and Gas
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, MCAE portals in Automotive
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, E-Design collaboration Black-box for EDA simulation
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Grid Portal in Telecom
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, DataGate
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Enterprise Portal for consolidation Centralized eDesign Services Citrix integration
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, HPC demo-center & ASP
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Usability & Input management User friendly, Application-oriented Job submission Flexible and efficient Input file management Hide complexity of Underlying scheduler
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Output management Data lifecycle managemnet Comprehensive output File manipulation (view, edit, delete, zip, …) Follow-up actions support
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, D preview integration
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Grid Intelligence
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Contents NICE Grids & Grid Portals Cases Histories Future Trends
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Services Aggregation Clients Standard Web Browser Compute/Data GRID Compute/Data GRID Dedicate d Servers Dedicate d Servers Farms Meta Dedicate d Servers Dedicate d Servers Farms Meta Different services from different Organizations are aggregated into a single cohesive offer! WSDL SOAP WebServices S WSDL SOAP WebServices S WSDL SOAP WebServices S Dedicated Servers Dedicated Servers Farms Meta
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, High performance networks Orthogonalization between “glass pipes” and illumination technology –“Future proof”: will survive the 10GbE to 40GbE transition (2007?) –Can support both GbE and Infiniband “application driven” network configuration –Explicit allocation of lambdas to multi-centers meta computers
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Grid Infrastructure vision eDesign Collaboration Grid Portal Active DataMiners CMMI Application Enterprise Metrics DataGate E-Gates HPC Applications Compute Grid …,Sap,Oracle, SAS, J2EE App Servers,… Grid OS VM
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Application Silos Business [demand] and compute resources [supply] are tightly coupled in silo-ed technology, applications, LOB, and second generation virtualization solutions. compute resource [supply] business [demand]
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, The Virtualization Evolution Grid OS compute resource [supply] business [demand]
Enabling Grids for E-sciencE GENIUS, GENIUSphere and EnginFrame EGEE User Forum, CERN, Q & AQ&A Thanks for your attention!