Middleware for Campus Grids Steven Newhouse, ETF Chair (& Deputy Director, OMII)

Slides:



Advertisements
Similar presentations
Delivering User Needs: A middleware perspective Steven Newhouse Director.
Advertisements

Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
INFSO-RI Enabling Grids for E-sciencE EGEE and gLite Slides by: Erwin Laure EGEE Deputy Middleware Manager.
Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre 1.The vision Thing, recent history and Organisation 2.Roles and Relationships.
The National Grid Service and OGSA-DAI Mike Mineter
Supporting the UK e-Science community and their international collaborators Steven Newhouse.
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.
18 April 2002 e-Science Architectural Roadmap Open Meeting 1 Support for the UK e-Science Roadmap David Boyd UK Grid Support Centre CLRC e-Science Centre.
OMII-Europe Repository Steven Newhouse Director, OMII-UK.
VO Support and directions in OMII-UK Steven Newhouse, Director.
OMII-UK Steven Newhouse, Director. © 2 OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community and its.
UK Campus Grid Special Interest Group Dr. David Wallom University of Oxford.
Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton.
MTA SZTAKI Hungarian Academy of Sciences Grid Computing Course Porto, January Introduction to Grid portals Gergely Sipos
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
1 CENTER FOR PARALLEL COMPUTERS An Introduction to Globus Toolkit® 3 -Developing Interoperable Grid services.
Globus Toolkit 4 hands-on Gergely Sipos, Gábor Kecskeméti MTA SZTAKI
John Kewley e-Science Centre GIS and Grid Computing Workshop 13 th September 2005, Leeds Grid Middleware and GROWL John Kewley
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
The OMII Position At the University of Southampton.
15th January, NGS for e-Social Science Stephen Pickles Technical Director, NGS Workshop on Missing e-Infrastructure Manchester, 15 th January, 2007.
1 OMII Release 1 Steven Newhouse, Peter Henderson Stephen Crouch & Karen Ng Presented by Mike Mineter for the NGS Induction Course
1 Application Specific Module for P-GRADE Portal 2.7 Application Specific Module overview Akos Balasko MTA-SZTAKI LPDS
1 Globus Developments Malcolm Atkinson for OMII SC 18 th January 2005.
Globus 4 Guy Warner NeSC Training.
Kate Keahey Argonne National Laboratory University of Chicago Globus Toolkit® 4: from common Grid protocols to virtualization.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.
The OMII Perspective on Grid and Web Services At the University of Southampton.
Holding slide prior to starting show. A Grid-based Problem Solving Environment for GECEM Maria Lin and David Walker Cardiff University Yu Chen and Jason.
OPEN GRID SERVICES ARCHITECTURE AND GLOBUS TOOLKIT 4
Software from Science for Science Steven Newhouse, Director.
Next Steps Guy Warner
The OMII Overview, Product and Roadmap. © University of Southampton omii OMII_1 Delivering a secure, reliable, web services infrastructure for grid applications.
NGS in the future: emerging middleware.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
Next Steps Mike Mineter
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
COMP3019 Coursework: Introduction to GridSAM Steve Crouch School of Electronics and Computer Science.
Training and the NGS Mike Mineter
Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
Stephen Pickles Technical Director, Grid Operations Support Centre University of Manchester Neil Geddes CCLRC Head of e-Science Director of the UK Grid.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
NGS in the future: emerging middleware.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
JRA Execution Plan 13 January JRA1 Execution Plan Frédéric Hemmer EGEE Middleware Manager EGEE is proposed as a project funded by the European.
CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.
OGSA-UK: Putting the users first Steven Newhouse OMII Deputy Director.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
The National Grid Service Mike Mineter.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
Testing Grid Software on the Grid Steven Newhouse Deputy Director.
Distributed Data for Science Workflows Data Architecture Progress Report December 2008.
Standards driven AAA for Job Management within the OMII-UK distribution Steven Newhouse Director, OMII-UK
Interactive Data Analysis on the “Grid” Tech-X/SLAC/PPDG:CS-11 Balamurali Ananthan David Alexander
Data Manipulation with Globus Toolkit Ivan Ivanovski TU München,
The National Grid Service Mike Mineter.
Holding slide prior to starting show. Lessons Learned from the GECEM Portal David Walker Cardiff University
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI UMD Roadmap Steven Newhouse 14/09/2010.
UK Grid Operations Support Centre All slides stolen by P.Clarke from a talk given by: Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations.
Bob Jones EGEE Technical Director
Introduction to the Application Hosting Environment
UK Grid: Moving from Research to Production
Stephen Pickles Technical Director, GOSC
Grid Systems: What do we need from web service standards?
Status of Grids for HEP and HENP
gLite The EGEE Middleware Distribution
Presentation transcript:

Middleware for Campus Grids Steven Newhouse, ETF Chair (& Deputy Director, OMII)

© Which Grid Middleware? gLite (EGEE) OMII GT4 UnitedDevices GridSystems CROWN ….

© What are your requirements? Research vs. supporting research Bleeding edge vs. production Your potential user community: ‘Intelligence’ Pain threshold Upfront cost vs. medium/long term costs

© ETF: Historical Role Started September 2001 Technical forum to build the UK Grid: GSC DTI/EPSRC Regional Centres Working Groups in 10+ areas Achievements: Established UK expertise Level 1 Grid: Basic compute/file grid Level 2 Grid: L1 + Application users

© ETF: Current Activities Integrated with GOSC 0.5 FTE from each regional centre Total 4 FTEs over ~12 people Leverage wider expertise within the community Evaluating software for production deployment Continue plenary meetings Focussed short–term ‘action lines’ Evaluation Criteria

© ‘Standard’ Evaluation Criteria Collect the same information Try and answer the same questions Focus on: General Background Information Systems Management User’s Experience Developer’s Experience Technical Relate to NGS environment

© ETF: In context OMII ETF NGS Distribution Other Software Services Prototypes & Specifications Software with proven capability & realistic deployment experience Feedback & future requirements EGEE Services

© ETF: Broader context UK Campus and other Grids NGS Operations Provider requirements GOSC Board User requirements ETF Software providers Software providers Software providers

© Secured Condor Pool Authorised Condor Flocking Use GSI to control access to daemons Flocking through firewalls

© UDDI Explore use of UDDI v2 Replication of registry No support at UDDI level Very hard to do at the database level Poor support for provenance & meta-data Grimoires from OMII to address some issues

© GridSystems Commercial product InnerGrid: Within the firewall OuterGrid: Between systems (not evaluated) Use of Tomcat/Axis as server Agents represent resources Modules represent applications Tasks represent modules running on agents

© GT4 Major new release of the Globus Toolkit Implementation of WSRF Improved GridFTP Improved WS-GRAM w.r.t. GT3.x Straightforward portable source & binary installers High quality structured documentation for installation & development Pure Java code OK on both Linux and Windows

© GT4 Components

© GT4 Migration From GT3: A few straight forward changes to service interfaces. Improved service performance & reliability From GT2.4: Pre WS components interoperate

© GT4 Issues No migration guide for GT2 developers BUT compatibility library for API Developing Grid systems As opposed to just GridServices Integration of new DRM into system Sun Grid Engine

© OMII 1:Basic Services Services to meet the needs of stakeholders Service Provider: I have something to share Users: I want to use these shared resources Functional: Data & Application execution Running jobs using pre-installed applications Movement of input and output data files Management: Account and Resources Must have an account with a service provider Or delegated access to someone else’s account

© OMII 1: Architecture database of accounts resources applications resources computation data storage applications Web Services Accounting Resource Mgmt Data Staging Job Submission Client Application Admin Application Management (Browser) Application WS Security Tomcat & Axis

© OMII 1: Stack WS-Security AXIS Happy Axis TOMCAT Static Webpage Acct Mgmt Servlet Resource Mgmt Servlet Account Allocation Data Job TestService ExampleService Application USER PBAC

© OMII 1: Summary Robust and straightforward deployment on supported platforms Applications need to be installed on the machine Does what it says on the tin What it does it does well

© gLite Early releases have been deployed OK Suggested deployment requires ~6 machines Package install OK (but gHeavy!) Configuration complex Evaluation on hold

© Summary Complete UDDI Registry Condor Finishing GridSystems GT4 OMII 1 Underway GridMP Distributed visualisation (RAVE) gLite (hibernating) CROWN Reports will go on the ETF website when complete. Feed into NGS deployment decisions