CMS-ARDA Workshop 15/09/2003 CMS/LCG-0 architecture Many authors…

Slides:

Advertisements

Similar presentations

Claudio Grandi INFN Bologna DataTAG WP4 meeting, Bologna 14 jan 2003 CMS Grid Integration Claudio Grandi (INFN – Bologna)

Advertisements

DataTAG WP4 Meeting CNAF Jan 14, 2003 Interfacing AliEn and EDG 1/13 Stefano Bagnasco, INFN Torino Interfacing AliEn to EDG Stefano Bagnasco, INFN Torino.

CMS Report – GridPP Collaboration Meeting IX Peter Hobson, Brunel University4/2/2004 CMS Status Progress towards GridPP milestones Data management – the.

CMS Grid Batch Analysis Framework

CHEP 2000, Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, Università di Catania and INFN Catania - Italy ALICE.

EU 2nd Year Review – Jan – Title – n° 1 WP1 Speaker name (Speaker function and WP ) Presentation address e.g.

Workload management Owen Maroney, Imperial College London (with a little help from David Colling)

FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.

Réunion DataGrid France, Lyon, fév CMS test of EDG Testbed Production MC CMS Objectifs Résultats Conclusions et perspectives C. Charlot / LLR-École.

Workload Management meeting 07/10/2004 Federica Fanzago INFN Padova Grape for analysis M.Corvo, F.Fanzago, N.Smirnov INFN Padova.

Runjob: A HEP Workflow Planner for Production Processing Greg Graham CD/CMS Fermilab CD Project Status Meeting 13-Nov-2003.

10 April 2003Deploy Grid in Israel Universities1 Deploy Grid testbed in Israel universities Lorne Levinson David Front Weizmann Institute.

School on Grid Computing – July 2003 – n° 1 A.Fanfani INFN Bologna – CMS WP8 – CMS experience on EDG testbed  Introduction  Use of EDG middleware in.

CHEP La Jolla - 24 March 2003 Running CMS software on Grid Testbeds Paolo Capiluppi Dept. of Physics and INFN Bologna On behalf of the CMS Collaboration.

INFN Testbed status report L. Gaido WP6 meeting CERN - October 30th, 2002.

A tool to enable CMS Distributed Analysis

CMS Report – GridPP Collaboration Meeting VIII Peter Hobson, Brunel University22/9/2003 CMS Applications Progress towards GridPP milestones Data management.

EDG Application The European DataGrid Project Team

6-Mar-2003Grids NOW 1 Grids Now: The USCMS Integration Grid Testbed and the European Data Grid Michael Ernst.

Dave Newbold, University of Bristol24/6/2003 CMS MC production tools A lot of work in this area recently! Context: PCP03 (100TB+) just started Short-term.

DataGrid is a project funded by the European Commission under contract IST Status and Prospective of EU Data Grid Project Alessandra Fanfani.

EU 2nd Year Review – Feb – Title – n° 1 WP8: Progress and testbed evaluation F Harris (Oxford/CERN) (WP8 coordinator )

Grid Testbed Activities in US-CMS Rick Cavanaugh University of Florida 1. Infrastructure 2. Highlight of Current Activities 3. Future Directions NSF/DOE.

HENP Grid Testbeds, Applications and Demonstrations Rob Gardner University of Chicago CHEP03 March 29, 2003 Ruth Pordes Fermilab.

Use of R-GMA in BOSS Henry Nebrensky (Brunel University) VRVS 26 April 2004 Some slides stolen from various talks at EDG 2 nd Review (

OSG Services at Tier2 Centers Rob Gardner University of Chicago WLCG Tier2 Workshop CERN June 12-14, 2006.

Claudio Grandi INFN Bologna ACAT'03 - KEK 3-Dec-2003 CMS Distributed Data Analysis Challenges Claudio Grandi on behalf of the CMS Collaboration.

F.Fanzago – INFN Padova ; S.Lacaprara – LNL; D.Spiga – Universita’ Perugia M.Corvo - CERN; N.DeFilippis - Universita' Bari; A.Fanfani – Universita’ Bologna;

Claudio Grandi INFN Bologna CHEP'03 Conference, San Diego March 27th 2003 Plans for the integration of grid tools in the CMS computing environment Claudio.

DataGrid is a project funded by the European Union VisualJob Demonstation EDG 1.4.x 2003 The EU DataGrid How the use of distributed resources can help.

DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.

11 December 2000 Paolo Capiluppi - DataGrid Testbed Workshop CMS Applications Requirements DataGrid Testbed Workshop Milano, 11 December 2000 Paolo Capiluppi,

WP8 Status – Stephen Burke – 30th January 2003 WP8 Status Stephen Burke (RAL) (with thanks to Frank Harris)

- Distributed Analysis (07may02 - USA Grid SW BNL) Distributed Processing Craig E. Tull HCG/NERSC/LBNL (US) ATLAS Grid Software.

CMS Stress Test Report Marco Verlato (INFN-Padova) INFN-GRID Testbed Meeting 17 Gennaio 2003.

Status of the LHCb MC production system Andrei Tsaregorodtsev, CPPM, Marseille DataGRID France workshop, Marseille, 24 September 2002.

November SC06 Tampa F.Fanzago CRAB a user-friendly tool for CMS distributed analysis Federica Fanzago INFN-PADOVA for CRAB team.

29 May 2002Joint EDG/WP8-EDT/WP4 MeetingClaudio Grandi INFN Bologna LHC Experiments Grid Integration Plans C.Grandi INFN - Bologna.

13 May 2004EB/TB Middleware meeting Use of R-GMA in BOSS for CMS Peter Hobson & Henry Nebrensky Brunel University, UK Some slides stolen from various talks.

Giuseppe Codispoti INFN - Bologna Egee User ForumMarch 2th BOSS: the CMS interface for job summission, monitoring and bookkeeping W. Bacchi, P.

Claudio Grandi INFN Bologna CHEP'03 Conference, San Diego March 27th 2003 BOSS: a tool for batch job monitoring and book-keeping Claudio Grandi (INFN Bologna)

LCG EGEE is a project funded by the European Union under contract IST LCG PEB, 7 th June 2004 Prototype Middleware Status Update Frédéric Hemmer.

US CMS Centers & Grids – Taiwan GDB Meeting1 Introduction l US CMS is positioning itself to be able to learn, prototype and develop while providing.

Presenter Name Facility Name UK Testbed Status and EDG Testbed Two. Steve Traylen GridPP 7, Oxford.

EDG Applications The European DataGrid Project Team

29/1/2002A.Ghiselli, INFN-CNAF1 DataTAG / WP4 meeting Cern, 29 January 2002 Agenda  start at  Project introduction, Olivier Martin  WP4 introduction,

29 Sept 2004 CHEP04 A. Fanfani INFN Bologna 1 A. Fanfani Dept. of Physics and INFN, Bologna on behalf of the CMS Collaboration Distributed Computing Grid.

1 Grid monitoring System (GridICE) Grid monitoring System (GridICE) DataTAG Collaboration: S.Andreozzi, S.Fantinel, A.Ghiselli, G.Tortone, C.Vistoli A.Ghiselli,

1 DataTAG-WP4 and GLUE ( mainly from A.Ghiselli II INFN-Grid workshop) Mirco Mazzucato Gridstart meeting at HPC Cetraro.

Summary from WP 1 Parallel Section Massimo Sgaravatto INFN Padova.

Testing the HEPCAL use cases J.J. Blaising, F. Harris, Andrea Sciabà GAG Meeting April,

US ATLAS – new grid initiatives John Huth Harvard University US ATLAS Software Meeting: BNL Aug 03.

The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

DataTAG is a project funded by the European Union International School on Grid Computing, 23 Jul 2003 – n o 1 GridICE The eyes of the grid PART I. Introduction.

CMS Production Management Software Julia Andreeva CERN CHEP conference 2004.

INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.

DataTAG is a project funded by the European Union CERN, 8 May 2003 – n o 1 / 10 Grid Monitoring A conceptual introduction to GridICE Sergio Andreozzi

June 22 L. Silvestris CMS/ARDA CMS/ARDA Lucia Silvestris INFN-Bari.

EDG Project Conference – Barcelona 13 May 2003 – n° 1 A.Fanfani INFN Bologna – CMS WP8 – Grid Planning in CMS Outline  CMS Data Challenges  CMS Production.

BaBar-Grid Status and Prospects

INFN-GRID Workshop Bari, October, 26, 2004

CMS Data Challenge Experience on LCG-2

ALICE Physics Data Challenge 3

Sergio Fantinel, INFN LNL/PD

CMS Data Challenge 2004 Claudio Grandi CMS Grid Coordinator

Scalability Tests With CMS, Boss and R-GMA

F Harris (OXFORD/CERN) Presented by I Augustin (CERN)

EDT-WP4 monitoring group status report

CMS report from FNAL demo week Marco Verlato (INFN-Padova)

Report on GLUE activities 5th EU-DataGRID Conference

Presentation transcript:

CMS-ARDA Workshop 15/09/2003 CMS/LCG-0 architecture Many authors…

P.Capiluppi 15/09/2003 CMS-ARDA Workshop 2 CMS/LCG-N testbed CMS/LCG-0 is a CMS-wide testbed based on the LCG pilot distribution (LCG-0), owned by CMS –Red Hat 7.3 (7.3.2 with CERN kernel recommended) –Components from VDT and EDG 1.4.X (LCG pilot) –Components from DataTAG (GLUE schemas and info providers) –Virtual Organization Management: VOMS –RLS in place of the replica catalogue (uses rlscms by CERN/IT!) –Monitoring: GridICE by DataTAG –R-GMA (as BOSS transport layer for specific tests) Dynamic: install+test new components useful to CMS Support (outside CMS) –DataTAG WP4 –LCG Experiment Integration and Support (EIS) team Currently configured as a CMS RC and producing data for PCP It allows us to do our software integration while LCG-1 is not out!!!

P.Capiluppi 15/09/2003 CMS-ARDA Workshop 3 CMS/LCG-0 sites SiteInstalledMonitoredPCP-readyUI CERN  PCP/data CNAF  CMKIN onlyPCP/sub Bari  PCP/sub Bologna  CNAF UI Bristol    Brunel   Tools devel Imperial College   Tools devel Islamabad-NCP    E.Polytechnique  PCP/sub Milano (EDT)  Legnaro  Padova  PCP/sub NCU/Taiwan    US Iowa  SE only  ~170 CPU’s

P.Capiluppi 15/09/2003 CMS-ARDA Workshop 4 MCRunjob +ImpalaLite or CMSProd CMS/LCG-0 as a CMS Regional Center Site Manager starts an assignment RefDB Phys.Group asks for an official dataset User starts a private production Production Manager defines assignments DAG job JDL shell scripts DAGMan (MOP) Local Batch Manager LCG Scheduler Computer farm CMS LCG-0 User’s Site (or grid UI) Resources Chimera VDL Virtual Data Catalogue Planner USCM S testbed

P.Capiluppi 15/09/2003 CMS-ARDA Workshop 5 SE CE CMS software CMS/LCG-0 PCP setup BOSS DB Workload Management System JDL RefDB parameters data registration Job output filtering Runtime monitoring input data location Push data or info Pull info UI CMSProd/ MCRunbjob +BOSS cmsrls CE CMS software CE CMS software CE WN SE CE CMS software SE UI BOSS DB SE CERN SE cmsrls Data replication LFN Job management

P.Capiluppi 15/09/2003 CMS-ARDA Workshop 6 Outcomes 4 UI’s testing different production tools –McRunjob/ImpalaLite (Bari, Bologna) complex! But consistent with “official” environment –CMSProd (Padova, Ecole Poly.) simple! Testbed is quite stable –500 Kevts “heavy” CMKIN (8 h /job (250 evts) ; ~20 GB) –500 Kevts CMSIM in production (350 Kevts/week; ~320 GB) Operates as a CMS Regional Centers –need to interact with existing environment, e.g.: not grid-aware comm. to/from RefDB: not grid-aware data transfer tools: SRB bridge at CERN –much more consistent architecture if we had only grid components! Only production services (no user analysis)