INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.

Slides:



Advertisements
Similar presentations
Last update 01/06/ :23 LCG 1Maria Dimou- cern-it-gd Maria Dimou IT/GD Site Registration policy & procedures
Advertisements

INFSO-RI Enabling Grids for E-sciencE Update on LCG/EGEE Security Policy and Procedures David Kelsey, CCLRC/RAL, UK
1 Deployment of an LCG Infrastructure in Australia How-To Setup the LCG Grid Middleware – A beginner's perspective Marco La Rosa
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
EGEE is a project funded by the European Union under contract IST The way ahead Alistair Mills Grid Deployment Group
EGEE-II INFSO-RI Enabling Grids for E-sciencE AP ROC Min-Hong Tsai ASGC SA1 Transition Meeting May 8 th, 2008
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Romanian SA1 report Alexandru Stanciu ICI.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Configuring and Maintaining EGEE Production.
LCG and HEPiX Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002.
GGF12 – 20 Sept LCG Incident Response Ian Neilson LCG Security Officer Grid Deployment Group CERN.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse EGEE’s plans for transition.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks PPS All sites Meeting: Introduction & Agenda.
Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager
INFSO-RI Enabling Grids for E-sciencE Plan until the end of the project and beyond, sustainability plans Dieter Kranzlmüller Deputy.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Kelsey RAL/STFC,
INFSO-RI Enabling Grids for E-sciencE Integration and Testing, SA3 Markus Schulz CERN IT JRA1 All-Hands Meeting 22 nd - 24 nd March.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Multi-level monitoring - an overview James.
JRA Execution Plan 13 January JRA1 Execution Plan Frédéric Hemmer EGEE Middleware Manager EGEE is proposed as a project funded by the European.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-EGI Grid Operations Transition Maite.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Security Coordination Group Linda Cornwall CCLRC (RAL) FP6 Security workshop.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks IPv6 test methodology Mathieu Goutelle (CNRS.
EGEE is a project funded by the European Union under contract IST EGEE Services Ian Bird SA1 Manager Cork Meeting, April
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA1: Grid Operations Maite Barroso (CERN)
INFSO-RI Enabling Grids for E-sciencE EGEE SA1 in EGEE-II – Overview Ian Bird IT Department CERN, Switzerland EGEE.
EGEE-III-INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-III All Activity Meeting Brussels,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The EGEE User Support Infrastructure Torsten.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Antonio Retico CERN, Geneva 19 Jan 2009 PPS in EGEEIII: Some Points.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Pre-production in EGEEIII Operation principles Antonio Retico EGEE-II / EGEE II SA1.
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
INFSO-RI Enabling Grids for E-sciencE GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGI Operations Tiziana Ferrari EGEE User.
DTI Mission – 29 June LCG Security Ian Neilson LCG Security Officer Grid Deployment Group CERN.
INFSO-RI Enabling Grids for E-sciencE An overview of EGEE operations & support procedures Jules Wolfrat SARA.
Ian Bird LCG Project Leader On the transition to EGI – Requirements from WLCG WLCG Workshop 24 th April 2008.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Communication tools between Grid Virtual.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid Monitoring Tools E. Imamagic, SRCE CE.
EGEE is a project funded by the European Union under contract IST Roles & Responsibilities Ian Bird SA1 Manager Cork Meeting, April 2004.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The EGEE User Support Infrastructure Alistair.
INFSO-RI SA2 ETICS2 first Review Valerio Venturi INFN Bruxelles, 3 April 2009 Infrastructure Support.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Ian Bird All Activity Meeting, Sofia
INFSO-RI Enabling Grids for E-sciencE gLite Certification and Deployment Process Markus Schulz, SA1, CERN EGEE 1 st EU Review 9-11/02/2005.
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
INFSO-RI Enabling Grids for E-sciencE Operations Parallel Session Summary Markus Schulz CERN IT/GD Joint OSG and EGEE Operations.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
EGEE is a project funded by the European Union under contract IST Service Activity 1 M.Cristina Vistoli ROC Coordinator All activity meeting,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operational Procedures (Contacts, procedures,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid is a Bazaar of Resource Providers and.
INFSO-RI Enabling Grids for E-sciencE Operational Security Coordination Team OSCT report EGEE-4, Pisa Ian Neilson, CERN.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Dashboard for Operations Cyril L’Orphelin.
Grid Deployment Technical Working Groups: Middleware selection AAA,security Resource scheduling Operations User Support GDB Grid Deployment Resource planning,
INFSO-RI Enabling Grids for E-sciencE EGEE general project update Fotis Karayannis EGEE South East Europe Project Management Board.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CYFRONET site report Marcin Radecki CYFRONET.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations automation team presentazione.
INFSO-RI Enabling Grids for E-sciencE GOCDB2 Matt Thorpe / Philippa Strange RAL, UK.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks IT ROC: Vision for EGEE III Tiziana Ferrari.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Nagios Grid Monitor E. Imamagic, SRCE OAT.
Bob Jones EGEE Technical Director
Regional Operations Centres Core infrastructure Centres
Operations Status Report
JRA3 Introduction Åke Edlund EGEE Security Head
SA1 Execution Plan Status and Issues
LCG Security Status and Issues
Ian Bird GDB Meeting CERN 9 September 2003
The CCIN2P3 and its role in EGEE/LCG
Maite Barroso, SA1 activity leader CERN 27th January 2009
LCG Operations Workshop, e-IRG Workshop
Leigh Grundhoefer Indiana University
Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002
Presentation transcript:

INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006

Enabling Grids for E-sciencE INFSO-RI All Activty Meeting; January Outline Scope and purpose Overall structure of document Summary of contents Future work

Enabling Grids for E-sciencE INFSO-RI All Activty Meeting; January Scope and goals Scope & goals –Summary of experience and knowledge gained in building the EGEE infrastructure. –Includes pre-EGEE work by LCG because that was part of getting to where we are now –Explain why we did it this way –Helpful to other grid projects – particularly related infrastructure projects –Not a user guide! Intended audience –Service managers, site administrators, site security managers –Support staff –Developers – hopefully to gain some insight into deployment issues –Other projects –General audience

Enabling Grids for E-sciencE INFSO-RI All Activty Meeting; January DSA1.7: Document Outline Executive Summary Structure of document Architecture Certification and Testing Security Grid Operations and Support User Support Fabric Management Appendices: –Deploying Additional Software Components –Middleware Requirements

Enabling Grids for E-sciencE INFSO-RI All Activty Meeting; January Architecture Introduction –Grid Functionality and Services –Interoperability EGEE Middleware –Catalogue of existing and anticipated middleware services:  Site Services  VO or Global Services  VDT Operating System Platforms

Enabling Grids for E-sciencE INFSO-RI All Activty Meeting; January Certification and Testing Introduction –Overview of process –Teams required Integration, Testing & Certification Process –Certification testbed –Pre-production service –Testing process –Certification process –Candidate and final release creation –Distribution process EGEE Software –Origins –Importance of user applications in testing –User requirements impact on sw development Evolution of EGEE software –LCG-0: learning –LCG-1: making the sw usable –LCG-2: the deployment release Evolution of the release process –Adding pps –Deployment feedback Lessons learned during LCG Lessons learned with EGEE  Lessons learned should be learned!

Enabling Grids for E-sciencE INFSO-RI All Activty Meeting; January Security Overview EGEE solution –CAs and PMAs –Virtual Organisations –Policy framework – trust –User registration process –Access to resources –Authentication and authorisation control points –Credential stores – MyProxy –Site registration process Lessons learned –Scaling the trust domain –Authorisation control –Proxy renewal complexity –Privacy, legal issues & accounting –Operational security issues

Enabling Grids for E-sciencE INFSO-RI All Activty Meeting; January Grid Operations & Support EGEE Grid Operations – overview Operations of the grid –The OMC –The pre-production service –The CICs –Operation of CIC on Duty –Operation of a ROC:  Those part of a CIC  Those not part of a CIC –Grid Operations Centre –Site Functional Tests –Incident operation security –Monitoring, automation, alarms –Support –Tools –Procedures, escalation –Metrics –SLAs Lessons learned, from each of: –OMC –PPS –CIC –COD –ROCs –GOC Ways forward to EGEE-II and beyond –PPS –COD

Enabling Grids for E-sciencE INFSO-RI All Activty Meeting; January User Support Introduction – problem statement Solution used in EGEE –Management initiatives Support Model –Central support –Regional support –CIC user support –VO user support –Support units Passive support –Documentation –Training Management –Procedures and escalations –Metrics –Support committee –SLAs Lessons learned –Document the model –SW for helpdesks –Need for experienced people as front-line –Simple mechanism for problem submission –Documentation up to date –…

Enabling Grids for E-sciencE INFSO-RI All Activty Meeting; January Fabric Management Overview of grid cluster components –For each service – comments on its use and interfaces Planning for a grid cluster –Server requirements –Worker node requirements –Storage requirements –Networking –Security Software not included in the grid package –Batch system –Cluster monitoring –OS Installation and updates Setup, installation, verification –Where to install components –Batch system –Cron jobs –Site verification Monitoring and maintenance –What to watch, and how often –Tool recommendations Lessons learned

Enabling Grids for E-sciencE INFSO-RI All Activty Meeting; January Appendices Deploying Additional components –MPI  Deployment documentation  Security issues  Other considerations  Open problems  Lessons learned –In future revisions this section can be used to describe how we support (or not!) application-level services, other higher-level middleware, etc. Middleware requirements –Overview of outstanding requirements on middleware that are not addressed by most mw suppliers:  General requirements  Installation & configuration  Development requirements

Enabling Grids for E-sciencE INFSO-RI All Activty Meeting; January Future EGEE-II has a deliverable: –DSA1.5: An update to the planning guide ("cookbook") published in EGEE.  This should show how things have developed in the light of further experience.  The scope will be expanded relative to the EGEE version to describe full range of services available through EGEE-II, DEISA, and GEANT2, as well as by the related infrastructure projects. This will be done in collaboration with those projects. GGF –Turn DSA1.7 into a contribution to Production Grids RG  Would need some reworking for a non-EGEE audience Fabric management should be a stand-alone document