Andreas Unterkircher CERN Grid Deployment

Slides:



Advertisements
Similar presentations
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA3 Partner Update: FOM Dennis van Dok Jan.
Advertisements

27-29 September 2002CrossGrid Workshop LINZ1 USE CASES (Task 3.5 Test and Integration) Santiago González de la Hoz CrossGrid Workshop at Linz,
Accounting Update Dave Kant Grid Deployment Board Nov 2007.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Release Process Maria Alandes Pradillo.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
EGEE is a project funded by the European Union under contract IST JRA1 Testing Activity: Status and Plans Leanne Guy EGEE Middleware Testing.
INFSO-RI Enabling Grids for E-sciencE Status of LCG-2 porting Stephen Childs, Brian Coghlan and Eamonn Kenny Grid-Ireland/EGEE October.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Simply monitor a grid site with Nagios J.
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite IPv6 compliance project tests Further.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GRNET SA3 Progress Report Ioannis Liabotis.
Maarten Litmaath (CERN), GDB meeting, CERN, 2006/02/08 VOMS deployment Extent of VOMS usage in LCG-2 –Node types gLite 3.0 Issues Conclusions.
INFSO-RI Enabling Grids for E-sciencE SA1 and gLite: Test, Certification and Pre-production Nick Thackray SA1, CERN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CERN status report SA3 All Hands Meeting.
CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
EGEE’06 Conference Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Testing gLite middleware: overview & status Andreas.
Enabling Grids for E-sciencE SGE J. Lopez, A. Simon, E. Freire, G. Borges, K. M. Sephton All Hands Meeting Dublin, Ireland 12 Dec 2007 Batch system support.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The GILDA t-Infrastructure Roberto Barbera.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
SAM Sensors & Tests Judit Novak CERN IT/GD SAM Review I. 21. May 2007, CERN.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GLite testing status and future Gianni Pucciani.
EGEE-II INFSO-RI Enabling Grids for E-sciencE YAIM Overview MiMOS Grid tutorial HungChe, ASGC OPS Team.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA3 partner collaboration tasks & process.
EGEE-III INFSO-RI Enabling Grids for E-sciencE SA3 All Hands Meeting 'Cluster of Competence' Experience SA3 INFN Cyprus May 7th-8th.
Automatic testing and certification procedure for IGI products in the EMI era and beyond Sara Bertocco INFN Padova on behalf of IGI Release Team EGI Community.
TP: Grid site installation BEINGRID site installation.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MSA3.4.1 “The process document” Oliver Keeble.
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
INFN GRID Production Infrastructure Status and operation organization Cristina Vistoli Cnaf GDB Bologna, 11/10/2005.
EGEE-II INFSO-RI Enabling Grids for E-sciencE SA3 Report Markus Schulz EGEE-II SA3 Activity Leader IT Department,
EGEE-II TCD 22 nd -25 th May 2007 Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Experiences with a distributed.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Status and outlook for testing in the LCG.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Implementing product teams Oliver Keeble.
EGEE-III INFSO-RI Enabling Grids for E-sciencE JRA1 and SA3 All Hands Meeting December 2009, CERN, Geneva Product Teams –
Enabling Grids for E-sciencE EGEE-III-INFSO-RI EGEE and gLite are registered trademarks Francesco Giacomini JRA1 Activity Leader.
SAM Status Update Piotr Nyczyk LCG Management Board CERN, 5 June 2007.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
INFSO-RI Enabling Grids for E-sciencE Software Process Author: Laurence Field (CERN) Presented by David Smith JRA1 All Hands meeting,
II EGEE conference Den Haag November, ROC-CIC status in Italy
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Towards an Information System Product Team.
EGEE-II INFSO-RI Enabling Grids for E-sciencE SA3 Report Markus Schulz For EGEE-II SA3 IT Department, CERN Final EU.
CREAM Status and plans Massimo Sgaravatto – INFN Padova
CESGA QR2 SA1-SWE Partner Coordination Meeting 2 CICA, Sevilla
Status & Strategy for gLite multi-platform Support
NGI and Site Nagios Monitoring
The EMT Oliver Keeble, SA3 CERN.
Operations Status Report
JRA1 Middleware Re-engineering Status Report
LCG Service Challenge: Planning and Milestones
Farida Naz Andrea Sciabà
Summary on PPS-pilot activity on CREAM CE
Claudio Grandi (INFN and CERN)
CREAM Status and Plans Massimo Sgaravatto – INFN Padova
The CREAM CE: When can the LCG-CE be replaced?
Partner Status HPCL-University of Cyprus
Testing for patch certification
Short update on the latest gLite status
Future Test Activities SA3 All Hands Meeting Dublin
Quality Control in the dCache team.
ETICS Services Management
Virtualization in the gLite Grid Middleware software process
Cristina del Cano Novales STFC - RAL
SAM Alarm Triggering and Masking
Francesco Giacomini – INFN JRA1 All-Hands Nikhef, February 2008
Porting LCG to IA64 Andreas Unterkircher CERN openlab May 2004
Site availability Dec. 19 th 2006
Installation/Configuration
Presentation transcript:

Andreas Unterkircher CERN Grid Deployment CERN Status Andreas Unterkircher CERN Grid Deployment

Introduction Arrivals More detailed talks later Felix Ehm Juha Herrala Distributed testbed (Louis) SL4, ETICS (Laurence) Yaim (Gergo) Documentation session (Oliver) SA3 all hands meeting

Build systems LCG build system for legacy components To be phased out during the year gLite build system Used for the gLite-3.0 branch ETICS Used for the gLite-3.1 branch Will be finished around August 2007 SA3 all hands meeting

Integration Priority: glite 3.1 on SL4 x86 Integration procedure WN available, UI in certification, WMS under way Integration procedure https://twiki.cern.ch/twiki//bin/view/EGEE/IntegrationProcedure Yum repository for SL4, apt for SL3 Integration scripts to automate the procedure Progress monitored on the Integration Dashboard (Node build status etc.) http://grid-deployment.web.cern.ch/grid-deployment//cgi-bin/reports.cgi?action=index Clean up of metapackages (UI, WN) GGUS support provided by CERN certification team has rotating first level support. SA3 all hands meeting

Configuration: YAIM Yaim 3.0.1 branch Yaim 3.1 branch Support for DNS like Vos Job priorities Many more features Yaim 3.1 branch Default for SLC4 glite-UI, glite-WN already available, WMS next Merge of 3.0 branch into 3.1 (will then also configure glite 3.0) SA3 all hands meeting

Testbed at CERN Different hardware: x86, x86_64 Different OS: SLC3, SLC4, SL4 More hardware just arrived to accommodate different HW/OS combinations. The introduction of the new CERN firewall caused problems. Many machines were no longer accessible from outside CERN and had to be opened step by step. SA3 all hands meeting

Distributed testbed We set up a CA issuing “Test User” certificates and also a dedicated VOMS server More security for automated tests. Allows to test different scenarios (roles, different users etc.) Rpms are not installed automatically. This causes problems as they are easily forgotten and tests thus fail. A TWiki page explains how to join the distributed testbed https://twiki.cern.ch/twiki/bin/view/EGEE/EGEETestbeds SA3 all hands meeting

Test development (1) SAM is being used successfully, the easySAM portal has been developed to suit the needs of the certification testbed. A central test result page has been set up https://twiki.cern.ch/twiki/bin/view/LCG/TestResults Contains results of Automated tests: SAM, SRM, DPM Manual tests: glite-CE, WMS, LFC, FTS-SRM Tests at GRNET (Torque, yaim) Tests at INFN (patches) Tests at PIC (Condor) Tests at TCD (RGMA) SA3 all hands meeting

Test development (2) Test writing guidelines have been improved “Adding new tests and publishing results with SAM” SAM documentation page has been set up http://sam-docs.web.cern.ch/sam-docs/ SA3 all hands meeting

Test development at CERN Tests developed UI testsuite SRM v2 (S2 testsuite) VOMS tests WMS tests (parametric jobs, interactive jobs) Manual testing WMS (until March 07) glite-CE SA3 all hands meeting

Available tests (1) Component Available tests Responsible BLAH 5 tests for basic functionality INFN Batch systems Scripts for Torque GRNET (Torque), INFN (LSF), PIC (Condor), CESGA (SGE) CE 19 tests CERN glite-CE 19 tests, manual test result page DGAS 5 tests DPM 41 tests FTS 7 tests Information System 1 basic tests INFN (until 04/07), CERN LB 4 tests ULB LFC 2 tests, 2 API tests, LFC performance test page CERN, LAL SA3 all hands meeting

Available tests (2) Component Available tests Responsible MyProxy 1 test CERN RGMA RGMA test result page, source code auditing TCD, PSNC RB edg-tests suite SE 3 tests SRM v.2 S2 testsuite, SRM2 test in DPM testsuite UI Extensive testsuite testing all commands listed in the user guide WN Tested by (glite-)CE and UI tests VOMS 28 tests, source code auditing WMS 3 tests, glite version of edg-tests, WMS test result page CERN, IMPERIAL, CSIC (WMProxy) List of available tests (with explanations and link to CVS): https://twiki.cern.ch/twiki/bin/view/LCG/SAMTests SA3 all hands meeting

Patch certification We treat about 5 patches per week (certified, rejected, obsolete) Until now 12 patches were treated by partners. The certification process is explained on the Twiki https://twiki.cern.ch/twiki/bin/view/EGEE/CertTestBedWorld SA3 all hands meeting

SA3 management SA3 phone conference once a month. All minutes available https://twiki.cern.ch/twiki/bin/view/EGEE/EGEEMeetings “SA3 Coordination” group in Savannah Tasks assigned to partners, comments are visible for everybody https://savannah.cern.ch/projects/sa3-coordination/ SA3 progress page Detailed view of the partners’ contribution. https://twiki.cern.ch/twiki/bin/view/EGEE/SAthreeProgress SA3 all hands meeting