Middleware for Campus Grids Steven Newhouse, ETF Chair (& Deputy Director, OMII)
© Which Grid Middleware? gLite (EGEE) OMII GT4 UnitedDevices GridSystems CROWN ….
© What are your requirements? Research vs. supporting research Bleeding edge vs. production Your potential user community: ‘Intelligence’ Pain threshold Upfront cost vs. medium/long term costs
© ETF: Historical Role Started September 2001 Technical forum to build the UK Grid: GSC DTI/EPSRC Regional Centres Working Groups in 10+ areas Achievements: Established UK expertise Level 1 Grid: Basic compute/file grid Level 2 Grid: L1 + Application users
© ETF: Current Activities Integrated with GOSC 0.5 FTE from each regional centre Total 4 FTEs over ~12 people Leverage wider expertise within the community Evaluating software for production deployment Continue plenary meetings Focussed short–term ‘action lines’ Evaluation Criteria
© ‘Standard’ Evaluation Criteria Collect the same information Try and answer the same questions Focus on: General Background Information Systems Management User’s Experience Developer’s Experience Technical Relate to NGS environment
© ETF: In context OMII ETF NGS Distribution Other Software Services Prototypes & Specifications Software with proven capability & realistic deployment experience Feedback & future requirements EGEE Services
© ETF: Broader context UK Campus and other Grids NGS Operations Provider requirements GOSC Board User requirements ETF Software providers Software providers Software providers
© Secured Condor Pool Authorised Condor Flocking Use GSI to control access to daemons Flocking through firewalls
© UDDI Explore use of UDDI v2 Replication of registry No support at UDDI level Very hard to do at the database level Poor support for provenance & meta-data Grimoires from OMII to address some issues
© GridSystems Commercial product InnerGrid: Within the firewall OuterGrid: Between systems (not evaluated) Use of Tomcat/Axis as server Agents represent resources Modules represent applications Tasks represent modules running on agents
© GT4 Major new release of the Globus Toolkit Implementation of WSRF Improved GridFTP Improved WS-GRAM w.r.t. GT3.x Straightforward portable source & binary installers High quality structured documentation for installation & development Pure Java code OK on both Linux and Windows
© GT4 Components
© GT4 Migration From GT3: A few straight forward changes to service interfaces. Improved service performance & reliability From GT2.4: Pre WS components interoperate
© GT4 Issues No migration guide for GT2 developers BUT compatibility library for API Developing Grid systems As opposed to just GridServices Integration of new DRM into system Sun Grid Engine
© OMII 1:Basic Services Services to meet the needs of stakeholders Service Provider: I have something to share Users: I want to use these shared resources Functional: Data & Application execution Running jobs using pre-installed applications Movement of input and output data files Management: Account and Resources Must have an account with a service provider Or delegated access to someone else’s account
© OMII 1: Architecture database of accounts resources applications resources computation data storage applications Web Services Accounting Resource Mgmt Data Staging Job Submission Client Application Admin Application Management (Browser) Application WS Security Tomcat & Axis
© OMII 1: Stack WS-Security AXIS Happy Axis TOMCAT Static Webpage Acct Mgmt Servlet Resource Mgmt Servlet Account Allocation Data Job TestService ExampleService Application USER PBAC
© OMII 1: Summary Robust and straightforward deployment on supported platforms Applications need to be installed on the machine Does what it says on the tin What it does it does well
© gLite Early releases have been deployed OK Suggested deployment requires ~6 machines Package install OK (but gHeavy!) Configuration complex Evaluation on hold
© Summary Complete UDDI Registry Condor Finishing GridSystems GT4 OMII 1 Underway GridMP Distributed visualisation (RAVE) gLite (hibernating) CROWN Reports will go on the ETF website when complete. Feed into NGS deployment decisions