Next Steps Mike Mineter

Slides:



Advertisements
Similar presentations
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MyProxy and EGEE Ludek Matyska and Daniel.
Advertisements

The National Grid Service Mike Mineter.
Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre 1.The vision Thing, recent history and Organisation 2.Roles and Relationships.
Data services on the NGS.
The National Grid Service and OGSA-DAI Mike Mineter
Support: Certificates and Helpdesks Andrew Richards (GSC/NGS) – CCLRC, RAL.
INFSO-RI Enabling Grids for E-sciencE EGEE and the National Grid Service Mike Mineter
Facilitating the use of eInfrastructure: NeSC Training Team Enabling, facilitating and delivering quality training in the UK and Internationally.
INFSO-RI Enabling Grids for E-sciencE Concepts of grid computing Guy Warner NeSC Training Team
INFSO-RI Enabling Grids for E-sciencE JRA3 2 nd EU Review Input David Groep NIKHEF.
The UK National Grid Service Using the NGS. Outline NGS Background Getting Certificates Acceptable usage policies Joining VO’s What resources will be.
Technology on the NGS Pete Oliver NGS Operations Manager.
The OMII Position At the University of Southampton.
Joining the Grid Andrew McNab. 28 March 2006Andrew McNab – Joining the Grid Outline ● LCG – the grid you're joining ● Related projects ● Getting a certificate.
15th January, NGS for e-Social Science Stephen Pickles Technical Director, NGS Workshop on Missing e-Infrastructure Manchester, 15 th January, 2007.
08/11/908 WP2 e-NMR Grid deployment and operations Technical Review in Brussels, 8 th of December 2008 Marco Verlato.
The OMII Perspective on Grid and Web Services At the University of Southampton.
“How to Connect Campus Grids to the NGS” Neil Geddes Director, GOSC The UK's National Grid Service is a project to deploy and operate a grid infrastructure.
The National Grid Service User Accounting System Katie Weeks Science and Technology Facilities Council.
Next Steps Guy Warner
Next Steps Mike Mineter
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
GOSC and NGS Status Neil Geddes Director, GOSC Thanks to Stephen Pickles and Andy Richards
The National Grid Service Guy Warner.
Production Grids Mike Mineter NeSC-TOE. EU project: RIO31844-OMII-EUROPE 2 Production Grids - examples 1.EGEE: Enabling Grids for e-Science 2.National.
Neil Geddes GridPP-10, June 2004 UK e-Science Grid Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
The UK’s Grid Operations Support Centre and National Grid Service Core Components of the UK’s e-Infrstructure Neil Geddes Director, GOSC All Hands Meeting,
Training and the NGS Mike Mineter
Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
Stephen Pickles Technical Director, Grid Operations Support Centre University of Manchester Neil Geddes CCLRC Head of e-Science Director of the UK Grid.
Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Kelsey RAL/STFC,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE EGEE training community.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE Gergely Sipos
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
The National Grid Service Mike Mineter
1 Joining the NGS Stephen Pickles Technical Director, GOSC GOSC face-to-face meeting, NeSC, 28/10/2004.
NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Moving Beyond Campus Grids Steven Young Oxford NGS.
Next Steps: becoming users of the NGS Mike Mineter
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Conference name Company name INFSOM-RI Speaker name The ETICS Job management architecture EGEE ‘08 Istanbul, September 25 th 2008 Valerio Venturi.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA1: Grid Operations Maite Barroso (CERN)
Next Steps.
The National Grid Service Mike Mineter.
INFSO-RI Enabling Grids for E-sciencE EGEE SA1 in EGEE-II – Overview Ian Bird IT Department CERN, Switzerland EGEE.
Middleware for Campus Grids Steven Newhouse, ETF Chair (& Deputy Director, OMII)
17/1/20051 NGS Status Stephen Pickles Technical Director, GOSC (with thanks to Andy Richards, NGS Co-ordinator) CERN, 17/1/2005
INFSO-RI Enabling Grids for E-sciencE GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,
1 The National Grid Service: An Overview Stephen Pickles University of Manchester Technical Director, GOSC Towards an NGS User Induction Course, NeSC,
DTI Mission – 29 June LCG Security Ian Neilson LCG Security Officer Grid Deployment Group CERN.
Rob Allan Daresbury Laboratory NW-GRID Training Event 26 th January 2007 Next Steps R.J. Allan CCLRC Daresbury Laboratory.
The National Grid Service Mike Mineter.
The National Grid Service Mike Mineter
The National Grid Service User Accounting System Katie Weeks Science and Technology Facilities Council.
Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
National Grid Service and EGEE Dr Andrew Richards Executive Director NGS e-Science Department, CCLRC.
UK Grid Operations Support Centre All slides stolen by P.Clarke from a talk given by: Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations.
“Training the Trainers” Introduction Mike Mineter.
The UK National Grid Service Andrew Richards – CCLRC, RAL.
The National e-Science Centre. eSI in Edinburgh NeSC Roles National: help coordinate and lead the UK e- Science Programme Community building activities,
Grid Computing and The National Grid Service.
Operations Support for the UK National Grid Service
Bob Jones EGEE Technical Director
Next Steps.
Next Steps.
UK Grid: Moving from Research to Production
Stephen Pickles Technical Director, GOSC
The National Grid Service
Leigh Grundhoefer Indiana University
The National Grid Service Mike Mineter NeSC-TOE
Presentation transcript:

Next Steps Mike Mineter

2 Acknowledgements Most slides are from GOSC / NGS: –Stephen Pickles –Neil Geddes –Andy Richards

3 Goal of talk Thus far the emphasis has been on what the NGS is, and how to use its core services. The goal of this talk is to ensure that intending users of the NGS know what support services and procedures are provided by GOSC.

4 Overview Story so far The Grid Operations Support Centre Joining the NGS More training??! Information sources

5 The story so far The National Grid Service is providing a production service It is a developing, dynamic service! –Core services in place: data, computation, portal –New middleware en route –More sites joining –International perspectives – EGEE, Teragrid Grid Operations Support Centre is poised to help you…

6 GOSC The Grid Operations Support Centre is a distributed “virtual centre” providing deployment and operations support for the UK e-Science programme.

7 ETF Audit Board Management Board Steering Committee Director GOSC Operations Board Operations Manager/ Technical Director Development Manager TRAINING Operations Board Security NGS Networking GOC GSC USERS

8 GOSC Roles  UK Grid Services  National Services  Authentication, authorization, certificate management, VO management, security, network monitoring, help desk + support centre.   NGS Services  Job submission, data transfer, data access and integration, resource brokering, monitoring, grid management services, operations centre,…  NGS core-node Services  CPU, (meta-) data storage, key software  Services coordinated with others (eg OMII, NeSC, LCG):  Integration testing, compatibility & Validation Tests, User Management, training  Administration:  Policies and acceptable use conditions  Resource providers: service level agreements,…  Coordinate deployment and Operations

9 Access Grid Certification Condor ETF For Information General GT2 GT3 GT4 Globus-MDS GridFTP Internal Maillist Myproxy NGS OGSA-DAI Project Registration RA Security SRB Support Notices Training Unicore

10 Joining the NGS As –Users –Projects (VO’s) –Resource providers

Enabling Grids for E-sciencE INFSO-RI How Do I Get A Certificate? You need a valid UK certificate before applying for an NGS account: –Contact the UK Certificate Authority. –You will probably need to provide non-electronic proof of identity to your local representative of the CA.  For example: a photocopy of your passport.  See –Ensure that you use the same browser (on the same computer) that you sent the request from to download your certificate. –Always keep this certificate secure.

Enabling Grids for E-sciencE INFSO-RI How Do I Get An NGS Account? Once you have your certificate: –If your browser has access to your UK Certificate go to (Easiest option.) –Otherwise you will need the Distinguished Name (DN) from your UK Certificate, then go to –You will need to provide a description of your reason for needing access, plus your expected CPU/Disk usage. –Make sure you read and agree to the Terms and Conditions of Usage – see

13 End-users: what to do You need a current UK e-Science Certificate Complete the application form on the NGS web site, and read the conditions of use: – Wait 1-2 weeks for peer review You gain access to all core nodes automatically (incl SRB) Contact GOSC to gain access to OGSA-DAI and Oracle Use the NGS and GSC web sites and help-desk Happy computing!

14 User Registration (Process) User Applies (Via Website) Application Submitted to Peer Review Panel Application QC Approved ? Rejected (User Notified) Accepted (User Notified) User added to NGS VO (includes SRB account) User added NGS-USER and NGS-ANNOUNCE Mailing lists

15 Projects and VOs Just need access to compute and data resources for users in your project? –Currently, mainly applications from individuals –project-based applications being dealt with case-by-case, as procedures are established –if in doubt, talk to us! Want to host your data on NGS? –consider GridFTP, SRB, Oracle, or OGSA-DAI –NGS maintains infrastructure –you populate and manage data Want to use NGS resources to provision services, portals for a community of users? –next slide

16 Providing services for a VO NGS resources can be used to provide a portal (or portlets) or other service for your community Deployment and security scenarios are negotiable NGS policies (core nodes): –your portal can present its own, or a delegated user’s credential to NGS, but tasks should be traceable to initiating end-user –you should not run your own services in user space without prior agreement of NGS and hosting site we need to know that services are secure, will not jeopardise operation of other NGS services, or consume too much precious resource on head nodes Talk to GOSC!

17 U of A HPCxHPCx UofD GOSC NGS Core Nodes: Host core services, coordinate integration, deployment and support +free to access resources for all VOs. Monitored interfaces + services NGS Partner Sites: Integrated with NGS, some services/resources available for all VOs Monitored interfaces + services NGS Affiliated Sites: Integrated with NGS, support for some VO’s Monitored interfaces (+security etc.) RAL Oxford Leeds Man. CSARCSAR U of B U of C Commercial Provider PSRE Resource providers

18 Resource providers Resource providers join the NGS by Defining level of service commitments Adopting NGS acceptable use and security policies Run compatible middleware –as defined by NGS Minimum Software Stack –and verified by compliance test suite Support monitoring and accounting Two levels of membership 1.Affiliates run compatible stack, integrated support 2.Partners also contribute “significant resources”

19 Affiliation Affiliates commit to: running NGS-compatible middleware –as defined in NGS Minimum Software Stack –this means users of affiliate’s resources can access these using same client tools they use to access NGS a well-defined level of service and problem referral mechanisms –SLD approved by NGS Management Board and published on NGS web-site providing technical, administrative, and security (CERT) contacts providing an account and mapping for daily compliance tests (GITS++) accepting UK e-Science certificates maintaining baseline of logs to assist problem resolution

20 Partnership Partners commit to same as affiliates, plus: making “significant” resources available to NGS users –creation of accounts/mappings –in future, VO support, pool accounts, etc recognise additional CAs with which UK e-Science programme has reciprocal agreements publish/provide additional information to support resource discovery, brokering ability to compile code for computational resources Bristol and Cardiff going through certification process now. supported by “buddies” and NGS-Rollout list useful feedback on viability of NGS Minimum Software Stack

21 More training? Watch Also for EGEE events and materials – repository. TELL US WHAT YOU WANT !!!! –In future versions of this course –In application developer courses –…..

22 NeSC UK Training Establishing set of core courses: –Induction, sysadmin, application devel.,… For EGEE (current and gLite), NGS Cooperating with OMII –Fundamentals: WS, WS-RF In NeSC national role: –Building collaborations to support/co-deliver training with UK e- science centres and VO’s –Establishing repository (for EGEE) and website In NeSC’s regional role, providing: –events in Scotland –Training and support for potential & current users of grids

23 Information Sources

24 EGEE Training activity homepage: Roadmap: training events since the start of EGEE LCG lcg.web.cern.ch/LCG/lcg.web.cern.ch/LCG/ NeSC The Grid Cafe More EU sites: “Concertation event” and EGEE conference e-Infrastructures Reflection Group EU WEB SITES

25 UK resources National Grid Service Grid Operations Support Centre National e-Science Centre UK Training Roadmap ALSO: regional centres, centres of excellence and NIEeS, NCeSS UK AHM –2004: –2005:

26 And finally….

27 The NGS Is providing a production service Currently has core resources, procedures and operations in place Is developing and expanding –Both organisationally and in middleware Is a “SERVICE” –Organised to respond to your requirements!!! –What do YOU want of the NGS? Tell GOSC ! GOSC: exists to support you!!!

28 Last chance for questions… and feedback.

29 Background slides

30 NGS- Production service Operating a production grid means valuing robustness and reliability over fashion. NGS cares about: –alignment/compatibility with leading international Grid efforts –special requirements of UK e-Science community –easy migration/upgrade paths –proven robustness/reliability –based on standards or standards-track specifications NGS cannot support everything Everyone wants service-oriented grids –but still settling out: WS-I, WS-I+, OGSI, WSRF, GT3, GT4, gLite Caution over OGSI/WSRF has led to wide convergence on GT2 for production grids and hence some inter-Grid compatibility

31 Certificate Authority