Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre 1.The vision Thing, recent history and Organisation 2.Roles and Relationships.

Slides:



Advertisements
Similar presentations
Delivering User Needs: A middleware perspective Steven Newhouse Director.
Advertisements

Project Overview Daniel Mallmann, Research Centre Juelich Alistair Dunlop, University of Southampton.
Interoperability and Usability of Grid Infrastructures Alistair Dunlop Achim Streit University of SouthamptonForschungszentrum Jülich.
An open source approach for grids Bob Jones CERN EU DataGrid Project Deputy Project Leader EU EGEE Designated Technical Director
S.L.LloydATSE e-Science Visit April 2004Slide 1 GridPP – A UK Computing Grid for Particle Physics GridPP 19 UK Universities, CCLRC (RAL & Daresbury) and.
R. MiddletonGridPP8 – Bristol – 23 rd September 2003Slide 1 UK eScience BoF Session AHM – Nottingham - September 2003 Intersecting UK Grid and EGEE/LCG/GridPP.
The National Grid Service Mike Mineter.
Data services on the NGS.
The National Grid Service and OGSA-DAI Mike Mineter
Support: Certificates and Helpdesks Andrew Richards (GSC/NGS) – CCLRC, RAL.
Supporting the UK e-Science community and their international collaborators Steven Newhouse.
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
INFSO-RI Enabling Grids for E-sciencE EGEE and the National Grid Service Mike Mineter
SWITCH Visit to NeSC Malcolm Atkinson Director 5 th October 2004.
02/07/03 Grid Support Centre 1 UK Grid Support Centre Alistair Mills CLRC e-Science Centre
OMII-UK Steven Newhouse, Director. © 2 OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community and its.
E-Science Update Steve Gough, ITS 19 Feb e-Science large scale science increasingly carried out through distributed global collaborations enabled.
Issues with Production Grids Tony Hey Director of UK e-Science Core Programme.
Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton.
Grid Infrastructure in the UK Neil Geddes. Why this talk ? LHC to 2020 –GridPP to 2011 –SRIF3 to 2010 ? Who was successful in SRIF3? –Thereafter ? PPARC.
INFSO-RI Enabling Grids for E-sciencE Concepts of grid computing Guy Warner NeSC Training Team
The UK National Grid Service Using the NGS. Outline NGS Background Getting Certificates Acceptable usage policies Joining VO’s What resources will be.
Technology on the NGS Pete Oliver NGS Operations Manager.
The OMII Position At the University of Southampton.
The OMII Perspective on Grid and Web Services At the University of Southampton.
“How to Connect Campus Grids to the NGS” Neil Geddes Director, GOSC The UK's National Grid Service is a project to deploy and operate a grid infrastructure.
Next Steps Mike Mineter
Next Steps Guy Warner
Next Steps Mike Mineter
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
1 st EGEE Conference – April UK and Ireland Partner Dave Kant Deputy ROC Manager.
Security Area in GridPP2 4 Mar 2004 Security Area in GridPP2 “Proforma-2 posts” overview Deliverables – Local Access – Local Usage.
The National Grid Service Guy Warner.
GGF-16 Athens Production Grid Computing in the UK Neil Geddes CCLRC Director, e-Science.
Production Grids Mike Mineter NeSC-TOE. EU project: RIO31844-OMII-EUROPE 2 Production Grids - examples 1.EGEE: Enabling Grids for e-Science 2.National.
Neil Geddes GridPP-10, June 2004 UK e-Science Grid Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
The UK’s Grid Operations Support Centre and National Grid Service Core Components of the UK’s e-Infrstructure Neil Geddes Director, GOSC All Hands Meeting,
Training and the NGS Mike Mineter
Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
Stephen Pickles Technical Director, Grid Operations Support Centre University of Manchester Neil Geddes CCLRC Head of e-Science Director of the UK Grid.
John Gordon CCLRC e-Science Centre LCG Deployment in the UK John Gordon GridPP10.
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
The National Grid Service Mike Mineter
1 Joining the NGS Stephen Pickles Technical Director, GOSC GOSC face-to-face meeting, NeSC, 28/10/2004.
NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Moving Beyond Campus Grids Steven Young Oxford NGS.
GridPP Building a UK Computing Grid for Particle Physics Professor Steve Lloyd, Queen Mary, University of London Chair of the GridPP Collaboration Board.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Campus grids: e-Infrastructure within a University Mike Mineter National e-Science Centre 14 February 2006.
The National Grid Service Mike Mineter.
Middleware for Campus Grids Steven Newhouse, ETF Chair (& Deputy Director, OMII)
Remarks on OGSA and OGSI e-Science All Hands Meeting September Geoffrey Fox, Indiana University.
17/1/20051 NGS Status Stephen Pickles Technical Director, GOSC (with thanks to Andy Richards, NGS Co-ordinator) CERN, 17/1/2005
HEP SYSMAN 23 May 2007 National Grid Service Steven Young National Grid Service Manager Oxford e-Research Centre University of Oxford.
1 The National Grid Service: An Overview Stephen Pickles University of Manchester Technical Director, GOSC Towards an NGS User Induction Course, NeSC,
An Introduction to UK e-Science Anne E Trefethen Deputy Director UK e-Science Core Programme.
The National Grid Service Mike Mineter.
The National Grid Service Mike Mineter
Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
National Grid Service and EGEE Dr Andrew Richards Executive Director NGS e-Science Department, CCLRC.
UK Grid Operations Support Centre All slides stolen by P.Clarke from a talk given by: Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations.
The UK National Grid Service Andrew Richards – CCLRC, RAL.
Operations Support for the UK National Grid Service
Bob Jones EGEE Technical Director
Next Steps.
Regional Operations Centres Core infrastructure Centres
UK Grid: Moving from Research to Production
Stephen Pickles Technical Director, GOSC
The National Grid Service
The National Grid Service Mike Mineter NeSC-TOE
Presentation transcript:

Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre 1.The vision Thing, recent history and Organisation 2.Roles and Relationships with others GOSC, NGS, GSC, EGEE/LCG, GRIDPP, OMII, ETF 3.Where we want to go next

The Vision Thing This UK Grid Operation Support Centre is a distributed virtual centre providing deployment and operations support for the UK e-Science programme. The centre is a collaboration of CCLRC, the University of Manchester, the University of Oxford, the University of Edinburgh and the White Rose Grid at the University of Leeds. The core of the GOSC is built around operation of the National Grid Service (NGS). The GOSC will support UK services for user authentication, user authorization and project organization, credential management, resource discovery, access portals to facilitate collaborative research and resource sharing across the UK and internationally. The principal roles of the GOSC (as defined in the original call) include: –Middleware deployment –Central grid service support –General User support and helpdesk –Network services –Grid Security –User and Administrator support –Interoperability and collaboration with international projects, e.g. EGEE and TeraGrid

NGS Today Projects e-Minerals e-Materials Orbital Dynamics of Galaxies Bioinformatics (using BLAST) GEODISE project UKQCD Singlet meson project Census data analysis MIAKT project e-HTPX project. RealityGrid (chemistry) Users Leeds Oxford UCL Cardiff Southampton Imperial Liverpool Sheffield Cambridge Edinburgh QUB BBSRC CCLRC. Interfaces OGSI::LiteWSRF::Lite

Tomorrow Web Services based National Grid Infrastructure

U of A HPCxHPCx UofD GOSC NGS Core Nodes: Host core services, coordinate integration, deployment and support +free to access resources for all VOs. Monitored interfaces + services NGS Sites: Integrated with NGS, some services/resources available for all VOs Monitored interfaces + services NGS Connected Sites: Integrated with NGS, support for some VOs Monitored interfaces (+security etc.) RAL Oxford Leeds Man. CSARCSAR U of B U of C Commercial Provider PSRE

UK e-Infrastructure LHC ISIS TS2 HPCx + HECtoR Regional and Campus grids Users get common access, tools, information, Nationally supported services, through NGS Integrated internationally VRE, VLE, IE

UK Core e-Science programme - Situation Today * Leeds Manchester * * Oxford RAL * Level-2 Grid National Grid Service * DL

The Future According to Hey NGSNGS UK Grid Operations Support Centre

ETF Audit Board Management Board Steering Committee Director GOSC Operations Board Operations Manager/ Technical Director Development Manager TRAINING Operations Board Security NGS Networking GOC GSC USERS

GOSC Roles UK Grid Services National Services Authentication, authorisation, certificate management, VO management, security, network monitoring, help desk + support centre. NGS Services Job submission, simple registry, data transfer, data access and integration, resource brokering, monitoring and accounting, grid management services, workflow, notification, operations centre. NGS core-node Services CPU, (meta-) data storage, key software Services to be coordinated with others (eg OMII, NeSC, LCG): Integration testing, compatibility & Validation Tests, User Management, training Administration: Policies and acceptable use SLAs, SLDs Coordinate deployment and Operations

SRB service OGSA-DAI service

Grid Operations Centre Responsibilities in EGEE UK focused screen UKERNA work to be integrated

Authentication, authorisation, certificate management, VO management, security. Helpdesk FAQ

One Stop Shop Click for help

UK Campus and other Grids GOSC + ETF Core of GOSC built around experience in deploying and running National Grid Service (NGS) –Support service Important to coordinate and integrate this with deployment and operations work in EGEE, LCG and similar projects. –e.g. EGEE – low level services, CA, GOC, CERT... Focus on deployment and operations, NOT development. OMII ETF NGS Other software sources Software with proven capability & realistic deployment experience Gold services Prototypes & specifications Feedback & future requirements EGEE… Deployment/testing/advice Operations

ETF Registry –A freely available UDDI implementation has been deployed/tested between 4 sites –Experience passed on to the GRIMOIRES OMII project. Secure Flocking of Condor –Condor pools at 4 sites have been flocked together, through firewalls –authentication through use of X.509 certifcates –OMII test bed Portals –Support access to the NGS. –Tied in with JISC VRE developments Evaluations –InnerGrid - Contractual issues delayed start - just started. –OMII – Start later this month –GT4 – Start later this month –gLite – start next month

OMII

LCG Used for batch production Now. worldwide de facto standards Currently trying to interface analysis S/W on top of gLite from EGEE Need to move out of the physics depts

GRIDPP UK Contribution to LCG –Also supports current users GridPP1 ( ) –33% deployment/operations –33% middleware dev. –33% applications GridPP2 ( ) –60% deployment/operations LCG2 -> EGEE –15% middleware dev. –25% applications Not just PPARC funding –Universities support LHC benefit from grid experience You should know/meet these people

Start from LCG2 Harden middleware Expand applications 32 from EU –The EU Grid Infrastructure –50% deployment/operations –lots at CERN matched by PP UK + I –training –GOC dev + ops –regional deployment+support T2 coordinators

Stuff We Dont Do Run a repository Develop software –contribute to developments to influence/adapt cf Ive got one of those you can have. You just need to … (Training – Edinburgh/NeSC are part of GOSC) Extensive user hand-holding and app support –Need the e-Science Centres –Priorities will be driven by users

How do I Join ? Acceptable use and Security policies Install required interfaces (~EGEE) –VDT –EGEE CE and SE interfaces (and Authorisation) –Monitoring and accounting Provide services as defined in your own SLD –Buys you representation at the board (?)

Core services to facilitate collaborative (grid) computing – run by GOSC Authentication (PKI X509) Job submission/batch service Resource brokering Authorisation Virtual Organisation management Certificate management Information service Data access/integration services (SRB/OGSA-DAI/DQPS) National Registry (of registrys) Data replication Data caching Grid monitoring Accounting UK e-Science Cert. gsi-ssh, globus-job-submit, condorG EDG-RB VOM/VOMS VOMS (+Grid3/EGEE) myProxy(++) BDII/Glue ? ETF ? ? EGEE ? EGEE/LCG + ETF +TeraGrid EGEE/LCG/ETF/GGF Web Services interfaces

Where Next? Make the NGS work –Resource Broker/scheduler –VO/Project support –Monitoring and Accounting Compatibility with EGEE Define and agree criteria for success Web Services National e-Infrastructure –Science and Innovation strategy

Timeline Q2Q4Q2Q3Q1Q4Q3Q2Q1Q EGEE gLite alpha release gLite release 1 OMII release NGS Expansion (Bristol, Cardiff…) OGSA-DAI WS plan NGS Production Service NGS WS Service EGEE gLite release OMII Release NGS Expansion WS2 plan NGS WS Service 2

The Last Slide We are in the game of providing a service –built on leading edge academic stuff ! The challenge –not the latest and greatest grid –not what any given user wants The solution –want to make it work for our researchers for our institutions –one site will not make a useful grid Sign people/users up (to the vision) –get out more

The End