UK National Grid Service Andrew Richards NGS Executive Director NGS IF08 – Manchester 4-5 th November www.ngs.ac.uk/innovationforum.

Slides:



Advertisements
Similar presentations
PRAGMA BioSciences Portal Raj Chhabra Susumu Date Junya Seo Yohei Sawai.
Advertisements

The e-Framework Bill Olivier Director Development, Systems and Technology JISC.
The National Grid Service Mike Mineter.
Data services on the NGS.
The National Grid Service and OGSA-DAI Mike Mineter
Grid Infrastructure in the UK Neil Geddes. Why this talk ? LHC to 2020 –GridPP to 2011 –SRIF3 to 2010 ? Who was successful in SRIF3? –Thereafter ? PPARC.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
The UK National Grid Service Using the NGS. Outline NGS Background Getting Certificates Acceptable usage policies Joining VO’s What resources will be.
CoreGRID Workpackage 5 Virtual Institute on Grid Information and Monitoring Services Authorizing Grid Resource Access and Consumption Erik Elmroth, Michał.
Technology on the NGS Pete Oliver NGS Operations Manager.
1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
15th January, NGS for e-Social Science Stephen Pickles Technical Director, NGS Workshop on Missing e-Infrastructure Manchester, 15 th January, 2007.
UK National Grid Service, a production grid infrastructure for a heterogeneous provider and user community David Wallom Technical Director.
© 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
GridPP Tuesday, 23 September 2003 Tim Phillips. 2 Bristol e-Science Vision National scene Bristol e-Science Centre Issues & Challenges.
Roles and Responsibilities
National Grid Service Enabling Collaboration Edinburgh 09 March 2010.
Using the WS-PGRADE Portal in the ProSim Project Protein Molecule Simulation on the Grid Tamas Kiss, Gabor Testyanszky, Noam.
The National Grid Service User Accounting System Katie Weeks Science and Technology Facilities Council.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
4 November 2008NGS Innovation Forum '08 11 NGS Clearspeed Resources Clearspeed and other accelerator hardware on the NGS Steven Young Oxford NGS Manager.
The UK NGI Claire Devereux NGI Manager. Overview What is it? Who does it include? How does it work? Why do we need it? How is it evolving and what does.
Andrew McNabNorthGrid, GridPP8, 23 Sept 2003Slide 1 NorthGrid Status Andrew McNab High Energy Physics University of Manchester.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ?? Athens, May 5-6th 2009 Community Support.
Neil Geddes GridPP-10, June 2004 UK e-Science Grid Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
09/09/15 TF-MSP Meeting: 09/09/15. CSC/FUNET. Espoo, Finland 1 JANET Reach Programme Mark Tysom, Jisc.
Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager
NGS Innovation Forum, Manchester4 th November 2008 Condor and the NGS John Kewley NGS Support Centre Manager.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
Towards a Virtual Institute for Research into eGovernment Prof. Zahir Irani & Dr Tony Elliman Information Systems Evaluation and Integration Group School.
EGEE-Forum – May 11, 2007 Enabling Grids for E-sciencE EGEE and gLite are registered trademarks A gateway platform for Grid Nicolas.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA3 Resources Robin McConnell.
DAME: A Distributed Diagnostics Environment for Maintenance Duncan Russell University of Leeds.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE EGEE training community.
Institute For Digital Research and Education Implementation of the UCLA Grid Using the Globus Toolkit Grid Center’s 2005 Community Workshop University.
NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Moving Beyond Campus Grids Steven Young Oxford NGS.
GridPP Building a UK Computing Grid for Particle Physics Professor Steve Lloyd, Queen Mary, University of London Chair of the GridPP Collaboration Board.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The GILDA training infrastructure.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
UK National Grid Service Andrew Richards NGS Executive Director Gillian Sinclair NGS Liaison Officer NGS IF08 – Manchester 4-5 th November
Utility Computing: Security & Trust Issues Dr Steven Newhouse Technical Director London e-Science Centre Department of Computing, Imperial College London.
Tony Doyle - University of Glasgow Introduction. Tony Doyle - University of Glasgow 6 November 2006ScotGrid Expression of Interest Universities of Aberdeen,
Performance analysis extracts from GridPP OC metrics report For UKI operations meeting 15 th June 2005.
Rob Allan Daresbury Laboratory NW-GRID Training Event 26 th January 2007 Next Steps R.J. Allan CCLRC Daresbury Laboratory.
The National Grid Service Mike Mineter.
The National Grid Service User Accounting System Katie Weeks Science and Technology Facilities Council.
1 Porting applications to the NGS, using the P-GRADE portal and GEMLCA Peter Kacsuk MTA SZTAKI Hungarian Academy of Sciences Centre for.
Welcome Grids and Applied Language Theory Dave Berry Research Manager 16 th October 2003.
Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
National Grid Service and EGEE Dr Andrew Richards Executive Director NGS e-Science Department, CCLRC.
Web Portal Access to Bioinformatics Resources on the NGS. Jonathan Churchill STFC eScience – RAL / NGS High Performance Computing Services Group.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Breaking the frontiers of the Grid R. Graciani EGI TF 2012.
UK Grid Operations Support Centre All slides stolen by P.Clarke from a talk given by: Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations.
The UK National Grid Service Andrew Richards – CCLRC, RAL.
SCI-BUS project Pre-kick-off meeting University of Westminster Centre for Parallel Computing Tamas Kiss, Stephen Winter, Gabor.
Piotr Bała, Marcin Radecki, Krzysztof Benedyczak
Bob Jones EGEE Technical Director
Ian Bird GDB Meeting CERN 9 September 2003
Stephen Pickles Technical Director, GOSC
Long-term Grid Sustainability
Grid Portal Services IeSE (the Integrated e-Science Environment)
The National Grid Service
HLRmon accounting portal
Presentation transcript:

UK National Grid Service Andrew Richards NGS Executive Director NGS IF08 – Manchester 4-5 th November

History of NGS Full production since September 2004 Phase 2 started in October 2006 New hardware at four core sites in September 2007 Work in progress to transition NGS to a SLA defined service

The NGS Core, Partners & Affiliates, June 2008

New Members in the pipeline NW-Grid –NW England regional grid, Manchester, Liverpool, Lancaster and Daresbury Lab. HECToR –UK National Supercomputer Brunel University –GridPP, Tier2 Durham University –GridPP, Tier2 Liverpool University –GridPP, Tier2 Royal Holloway –GridPP, Tier2 EDINA and MIMAS –National Data Centres Aberystwyth Aston Daresbury –CATS hybrid cluster Hull Plymouth RAL –Visualization Cluster WRGrid –NE England regional grid, Sheffield, York and Leeds DIAMOND –National Synchrotron resource

Types of Member Site Core –Dedicated compute and/or data focused hardware purchased through the project Partner –Regularly tested installation of NGS defined interfaces –Supporting the NGS users Virtual Organisation –Complete a service level description (SLD) Affiliate –Regularly tested installation of NGS defined interfaces –Maintains control over permitted users

What does the NGS offer? Compute services –Access to more and different resources –Different ways of running jobs e.g. multi site MPI Data services –Access to data storage –Support and advice –New ways of accessing data Access Services –Methods to use collected externally available resources

Applications Many applications installed on the NGS! Standard compilers on all core sites Other applications include: –Abaqus –Amber –Siesta –Gaussian –Octave –Gadget –Fasta –NAMD –LAMMPS –BLAST –R –ROOT –GAMESS –DOCK –DL_POLY And more…..

User access to the NGS Directly submit jobs using an installation of the Globus Toolkit on user workstation GSI-SSH terminal to connect to the resource broker or a site –Web applet or easy install stand alone application Applications repository for web-based access running applications P-GRADE portal for workflow Application Hosting Environment for MPI across the WAN gLite UI system

Econometric analysis Molecular Dynamics Examples Protein - drug interactions Astrophysics data storage and analysis

NGS Future

Service Delivery The following services are classed as the core components needed to support grid/e-infrastructure related research within the UK. –This service list is not fixed and can be increased or decreased dependant on specific service demand or changing service requirements of the NGS project partners. –The list of core services provided will be reviewed every 6 months to ensure developing customer requirements are met. Service Management Outreach Training UK CA Support service Auxiliary Services e.g. MyProxy, VOMS, Accounting Exchange Service, Monitoring Operational Security OPN International engagement/interface

Project Work-packages 1.Project Management –Day to day project management to oversee transition from project to service. 2.Service Delivery –Oversee ongoing service management. 3.Transition to SLA –To define and SLA that meets the service requirements of the JISC and facilitates cross funding body work and the ability to define and meet specific requirements with other such funding bodies. 4.Accounting and charging models –Implement a national accounting exchange framework to facilitate exchange of accounting data between institutes and enable institutes to charge for resource usage. –Explore charge models, and mechanisms for charging, that an institute may adopt to facilitate provisioning services on a charged for basis 5.Partner support and development –Provide support (buddying) to HEI’s to assist with installation and becoming an NGS partner resource. –Development of tools to meet HEI requirements to assist with joining NGS –Increase participation in NGS Operations forums to facilitate community support across HEI’s

Commissioned Services Additional services and resources above and beyond those of the core ‘business as usual’ services –Through either direct funding from the NGS or other funding sources. N.b. Some additional service could be free e.g. provision of lightpaths at no cost to NGS/resources as ja.net provisioned to provide –During the transition phase of NGS-3 some of these services will initially be funded from the NGS grant and transitioned to separate partner/commissioned services which are sustained in line with user requirements through direct funding or appropriate cost recovery/charge models. Examples: –Compute services (free and charged for) –Data Storage –Visualisation –Specialist training facilities –CSE type support –Light Path connections –Etc.

Next steps Broad discussion with stakeholders –Users, HPC-SIG, Campusgrid-SIG, GridPP… Include key people in proposal development –DB, PELC … Develop ideas/proposal through September Proposal to JISC late October –And to EPSRC too Input from GridPP...