Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.

Slides:



Advertisements
Similar presentations
Large-Scale, Adaptive Fabric Configuration for Grid Computing Peter Toft HP Labs, Bristol June 2003 (v1.03) Localised for UK English.
Advertisements

Delivering User Needs: A middleware perspective Steven Newhouse Director.
Neil Geddes CCLRC Director, e-Science Director, Grid Operations Support Centre The UK National Grid Service.
W w w. h p c - e u r o p a. o r g HPC-Europa Portal: Uniform Access to European HPC Infrastructure Ariel Oleksiak Poznan Supercomputing.
March 6 th, 2009 OGF 25 Unicore 6 and IPv6 readiness and IPv6 readiness
GLUE 2.0 and GLUEMan Sergio Andreozzi, INFN-CNAF, Bologna (Italy) OGF Feb 2008, Cambridge, MA, USA.
Web: OMII-UK: progressing from adopting open specifications to sustainable open development by fostering Asia-Pacific.
© 2007 Open Grid Forum Data Management Challenge - The View from OGF OGF22 – February 28, 2008 Cambridge, MA, USA Erwin Laure David E. Martin Data Area.
Project Overview Daniel Mallmann, Research Centre Juelich Alistair Dunlop, University of Southampton.
Interoperability and Usability of Grid Infrastructures Alistair Dunlop Achim Streit University of SouthamptonForschungszentrum Jülich.
DG INFSO- Grid Research & Infrastructures: W. Boch, M. Campolargo 1 Delivery of Industrial-strength Grid Middleware: establishing an effective European.
Grid Initiatives for e-Science virtual communities in Europe and Latin America The VRC-driven GISELA Science Gateway Diego Scardaci.
GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.
The National Grid Service Mike Mineter.
Research Councils ICT Conference Welcome Malcolm Atkinson Director 17 th May 2004.
Data services on the NGS.
WS-JDML: A Web Service Interface for Job Submission and Monitoring Stephen M C Gough William Lee London e-Science Centre Department of Computing, Imperial.
The National Grid Service and OGSA-DAI Mike Mineter
Supporting the UK e-Science community and their international collaborators Steven Newhouse.
OMII-Europe Repository Steven Newhouse Director, OMII-UK.
Web: The Future of OMII-UK e-Science: the Changing Landscape 17 April 2009 Neil Chue Hong.
VO Support and directions in OMII-UK Steven Newhouse, Director.
OMII-UK Steven Newhouse, Director. © 2 OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community and its.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI AAI in EGI Status and Evolution Peter Solagna Senior Operations Manager
Slide: 1 Welcome to the workshop ESRFUP-WP7 User Single Entry Point.
VOMS & SAML Valerio Venturi MWSG /6/07. EU project: RIO31844-OMII-EUROPE OMII-Europe OMII-Europe is an EU-funded project which has been established.
Polish Infrastructure for Supporting Computational Science in the European Research Space EUROPEAN UNION Services and Operations in Polish NGI M. Radecki,
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
The OMII-Europe Project and the Impact of European Union Funding Dr Alistair Dunlop University of Southampton.
Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.
1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
UNICORE UNiform Interface to COmputing REsources Olga Alexandrova, TITE 3 Daniela Grudinschi, TITE 3.
Globus Computing Infrustructure Software Globus Toolkit 11-2.
© 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Building components for Grid Interoperability Stephen Brewer, Deputy Project Manager, OMII-Europe OGF 22 – Boston, MA.
What is OMII-Europe? Qin Li Beihang University. EU project: RIO31844-OMII-EUROPE 1 What is OMII-Europe? Open Middleware Infrastructure Institute for Europe.
Web: Towards Grid Interoperability Richard Boardman, Stephen Crouch, Hugo Mills, Steven Newhouse, Juri Papay and.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
JRA1/Job Submission and Monitoring Moreno Marzolla on behalf of JRA1/Job Submission Task INFN Sezione di Padova,
© 2006 Open Grid Forum Enabling Pervasive Grids The OGF GIN Effort Erwin Laure GIN-CG co-chair, EGEE Technical Director
Training and the NGS Mike Mineter
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks, An Overview of the GridWay Metascheduler.
Grid Middleware Tutorial / Grid Technologies IntroSlide 1 /14 Grid Technologies Intro Ivan Degtyarenko ivan.degtyarenko dog csc dot fi CSC – The Finnish.
NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Moving Beyond Campus Grids Steven Young Oxford NGS.
RI The DEISA Sustainability Model Wolfgang Gentzsch DEISA-2 and OGF rzg.mpg.de.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Conference name Company name INFSOM-RI Speaker name The ETICS Job management architecture EGEE ‘08 Istanbul, September 25 th 2008 Valerio Venturi.
Middleware for Campus Grids Steven Newhouse, ETF Chair (& Deputy Director, OMII)
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Project Overview Dr Fredrik Hedman Royal Institute of Technology (PDC/KTH)
Identity Management in DEISA/PRACE Vincent RIBAILLIER, Federated Identity Workshop, CERN, June 9 th, 2011.
Easy Access to Grid infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) Dr. Mathias Stuempert (KIT-SCC, Karlsruhe) EGEE User Forum 2008 Clermont-Ferrand,
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
EGEE Project Review Fabrizio Gagliardi EDG-7 30 September 2003 EGEE is proposed as a project funded by the European Union under contract IST
EGI Technical Forum Amsterdam, 16 September 2010 Sylvain Reynaud.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Evolution of AAI for e- infrastructures Peter Solagna Senior Operations Manager.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI UMD Roadmap Steven Newhouse 14/09/2010.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
REST API to develop application for mobile devices Mario Torrisi Dipartimento di Fisica e Astronomia – Università degli Studi.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
ETICS, EU-OMII and the Software Repository Andrea Caltroni, INFN Padova ETICS 1 st All-Hands Meeting, Budapest - May 29-31, 2006.
Bob Jones EGEE Technical Director
Ian Bird GDB Meeting CERN 9 September 2003
Building Components for Grid Interoperability
Status and Future Steps
Building components for Grid Interoperability
Grid Systems: What do we need from web service standards?
Presentation transcript:

Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh

EU project: RIO31844-OMII-EUROPE 2 Outline Effect of the grid islands Bridging grid islands What OMII-Europe is Doing

EU project: RIO31844-OMII-EUROPE 3 Revision Grid supports virtual computing across administrative domains EGEE and most grids have Virtual Organisation concept –A VO is a collaboration –Shares resources –Express membership of VO, its groups and roles in some way as a basis for grid services to authorise users requests

EU project: RIO31844-OMII-EUROPE 4 Grid Islands gLiteGlobus Toolkit 4 UNICORE CROWN Isolate: Data Computers Expertise

EU project: RIO31844-OMII-EUROPE 5 Effect of grid islands A VO can only use resources that share the same Authorisation/Authentication basis –Cant span UNICORE and EGEE grids for example EGEE – EU-funded grid infrastructure promoting collaborative research by sharing access to data and clusters, gLite with VOMS (Virtual Organisation Membership Service) DEISA – grid spanning HPC resources, built on UNICORE middleware Applications must be written for specific grid Disincentive for tool / high level service developers Need standards that all grids accept… and are complete! –Complete = if standards are supported, then services are interoperable

EU project: RIO31844-OMII-EUROPE 6 Bridges – to enable… gLiteGlobus Toolkit 4 UNICORE CROWN The global grid VO to span grids Application portability

EU project: RIO31844-OMII-EUROPE 7 Bridges – for interoperability gLiteGlobus Toolkit 4 UNICORE CROWN Job execution Data access and integration Accounting Info Services AuthN, AuthZ …

EU project: RIO31844-OMII-EUROPE 8 Approaches to Interoperability Adapters-based: –The ability of Grid middleware to interact via adapters that translate the specific design aspects from one domain to another Standard-based: –the native ability of Grid middleware to interact directly via well-defined interfaces and common open standards * definition inspired by OGF GIN CG

EU project: RIO31844-OMII-EUROPE 9 Who Benefits from Interoperability? Grid Developers –A single standard set of services on all Grid middleware systems –Applications portable across different Grid middleware systems E-Science application users –Common ways for accessing any e-infrastructure resources –Potential access to a significantly larger set of resources E-resource owners –Reduced management overheads as only a single Grid middleware system needs deployment –Potential for greater resource utilisation For the Grid to deliver on its promises interoperability needs to be taken for granted like network interoperability

EU project: RIO31844-OMII-EUROPE 10 How to achieve interoperability? Application level –SAGA – support same API on all grids –Interoperability or simply easier, portable applications? Need –Conform to standards –BUT standards are not enough (at present) –E.g. Common security basis OMII-Europe: build components in negotiation with gLite, UNICORE, Globus, CROWN

EU project: RIO31844-OMII-EUROPE 11 Web Services Grid Technology Grid Services Commerce Standards Tools Research driven Data-intensive Compute intensive Collaboration – sharing of resources - Trust: opening resources October 2001 View Open Grid Services Architecture

EU project: RIO31844-OMII-EUROPE 12 What OMII-Europe is Doing? Initial focus on providing common interfaces and integration of major Grid software infrastructures Common interoperable services: –Database Access –Virtual Organisation Management –Accounting –Job Submission and Job Monitoring Infrastructure integration –Initial gLite/UNICORE/Globus interoperability –Interoperable security framework –Access these infrastructure services through a portal

EU project: RIO31844-OMII-EUROPE 13 The Virtuous Cycle – Technology transfer with Grid projects and standards organisations Globus OMII-UK CROWN Components IN OUT JRA1 SA2 JRA4 JRA3 SA1 SA3 JRA2 New Components Standards Implementation Standards Compliance Testing and QA Benchmarking Integrated Components Supported Components on Eval. Infrastructure Repository

EU project: RIO31844-OMII-EUROPE 14 You will easily be able to find out! Evaluation infrastructures Common security base Components based on standards OMII-Europe Gateway (portal) Components – How easy are they to use?

EU project: RIO31844-OMII-EUROPE 15 Participation in Middleware Standardisation Most project participants involved as member/observer in many OGF WG 11 project participant hold senior positions in –OGSA DAIS WG (Database Access and Integration Services) –OGSA RUS WG (Resource Usage Server) –OGSA BES WG (Basic Execution Service) –OGSA JSDL WG (Job Submission Description Language) –GIN CG (Grid Interoperability Now) –OGSA-AuthZ-WG (Authorization) –GLUE WG –GFSG WG (Grid File System) –RM WG (Reference Model) –OGSA Naming WG –Technical Standards Committee –GSA RG (Grid Scheduling Architecture) –GRAAP WG (Grid Research Agreement Allocation Protocol) –OGSA BYTE IO WG –OGSA D WG (Data) –OGSA DMI WG (Data Movement Interface)

EU project: RIO31844-OMII-EUROPE 16 Summary OMII-Europe is a 24 Month EU funded project with 16 partners to establish grid infrastructure interoperability through implementing a set of agreed open standards on all middleware platforms OMII-Europe is implementing a number of components that will allow identically specified jobs to be run, managed and migrated to different middleware platforms Users can try interoperability on the OMII-Europe evaluation infrastructure, or obtain services for installation on their own resources from the OMII-Europe repository We anticipate OMII-Europe services will be integrated into standard middleware distributions - already in UNICORE 6

EU project: RIO31844-OMII-EUROPE 17 Further Information