Claudio Grandi INFN Bologna DataTAG WP4 meeting, Bologna 14 jan 2003 CMS Grid Integration Claudio Grandi (INFN – Bologna)

Slides:



Advertisements
Similar presentations
Activités CMS/Grille C.Charlot/LLR-École Polytechnique.
Advertisements

SPGrid Activities in Italy Daniele Andreotti - Enrica Antonioli - Paolo Veronesi BaBarGrid Workshop Padova, Nov 2003.
CHEP 2000, Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, (*) work in collaboration.
Claudio Grandi Università di Bologna - INFN 13/12/2000INFN-grid WP 2.4 Ideas for tests with Objectivity and AMS Claudio Grandi Università di Bologna &
DataTAG WP4 Meeting CNAF Jan 14, 2003 Interfacing AliEn and EDG 1/13 Stefano Bagnasco, INFN Torino Interfacing AliEn to EDG Stefano Bagnasco, INFN Torino.
The DataTAG Project 25 March, Brussels FP6 Information Day Peter Clarke, University College London.
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – HEP Assessment of EDG – n° 1 HEP Applications Evaluation of the EDG Testbed.
ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.
CHEP 2000, Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, Università di Catania and INFN Catania - Italy ALICE.
EU 2nd Year Review – Jan – Title – n° 1 WP1 Speaker name (Speaker function and WP ) Presentation address e.g.
Evaluation of the Globus Toolkit: Status Roberto Cucchi – INFN Cnaf Antonia Ghiselli – INFN Cnaf Giuseppe Lo Biondo – INFN Milano Francesco Prelz – INFN.
November 21, 2002Luca Vaccarossa INFN - Milano1 Interoperability Demos and Atlas applications Luca Vaccarossa (INFN - Milano) ATLAS Software Workshop 21/11/2002.
Réunion DataGrid France, Lyon, fév CMS test of EDG Testbed Production MC CMS Objectifs Résultats Conclusions et perspectives C. Charlot / LLR-École.
A. Arbree, P. Avery, D. Bourilkov, R. Cavanaugh, S. Katageri, G. Graham, J. Rodriguez, J. Voeckler, M. Wilde CMS & GriPhyN Conference in High Energy Physics,
CMS-ARDA Workshop 15/09/2003 CMS/LCG-0 architecture Many authors…
CMS HLT production using Grid tools Flavia Donno (INFN Pisa) Claudio Grandi (INFN Bologna) Ivano Lippi (INFN Padova) Francesco Prelz (INFN Milano) Andrea.
GRID workload management system and CMS fall production Massimo Sgaravatto INFN Padova.
Reliability and Troubleshooting with Condor Douglas Thain Condor Project University of Wisconsin PPDG Troubleshooting Workshop 12 December 2002.
GRID DATA MANAGEMENT PILOT (GDMP) Asad Samar (Caltech) ACAT 2000, Fermilab October , 2000.
School on Grid Computing – July 2003 – n° 1 A.Fanfani INFN Bologna – CMS WP8 – CMS experience on EDG testbed  Introduction  Use of EDG middleware in.
CHEP La Jolla - 24 March 2003 Running CMS software on Grid Testbeds Paolo Capiluppi Dept. of Physics and INFN Bologna On behalf of the CMS Collaboration.
CMS Software & Computing C. Charlot / LLR-École Polytechnique, CNRS & IN2P3 for the CMS collaboration.
GRID Workload Management System Massimo Sgaravatto INFN Padova.
The EDG Testbed Deployment Details The European DataGrid Project
6-Mar-2003Grids NOW 1 Grids Now: The USCMS Integration Grid Testbed and the European Data Grid Michael Ernst.
Dave Newbold, University of Bristol24/6/2003 CMS MC production tools A lot of work in this area recently! Context: PCP03 (100TB+) just started Short-term.
History of the National INFN Pool P. Mazzanti, F. Semeria INFN – Bologna (Italy) European Condor Week 2006 Milan, 29-Jun-2006.
CMS Report – GridPP Collaboration Meeting VI Peter Hobson, Brunel University30/1/2003 CMS Status and Plans Progress towards GridPP milestones Workload.
EU 2nd Year Review – Feb – Title – n° 1 WP8: Progress and testbed evaluation F Harris (Oxford/CERN) (WP8 coordinator )
Grid Testbed Activities in US-CMS Rick Cavanaugh University of Florida 1. Infrastructure 2. Highlight of Current Activities 3. Future Directions NSF/DOE.
HEP Experiment Integration within GriPhyN/PPDG/iVDGL Rick Cavanaugh University of Florida DataTAG/WP4 Meeting 23 May, 2002.
DataGrid is a project funded by the European Commission under contract IST GridPP Edinburgh 4 Feb 2004 WP8 HEP Applications Final Project evaluation.
BaBar Grid Computing Eleonora Luppi INFN and University of Ferrara - Italy.
Claudio Grandi INFN Bologna ACAT'03 - KEK 3-Dec-2003 CMS Distributed Data Analysis Challenges Claudio Grandi on behalf of the CMS Collaboration.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Claudio Grandi INFN Bologna CHEP'03 Conference, San Diego March 27th 2003 Plans for the integration of grid tools in the CMS computing environment Claudio.
05/23/2002Flavia Donno, INFN-Pisa1 DataTAG experiment grid integration plan Flavia Donno, INFN-Pisa DataTAG/iVDGL joint meeting, May 2002.
11 December 2000 Paolo Capiluppi - DataGrid Testbed Workshop CMS Applications Requirements DataGrid Testbed Workshop Milano, 11 December 2000 Paolo Capiluppi,
WP8 Status – Stephen Burke – 30th January 2003 WP8 Status Stephen Burke (RAL) (with thanks to Frank Harris)
27-28 August 2002Flavia Donno, INFN-Pisa1 Report on GLUE activities Flavia Donno, INFN-Pisa EDG Retreat August 2002.
LCG / ARC Interoperability Status Michael Grønager, PhD (UNI-C / NBI) January 19, 2006, Uppsala.
CMS Stress Test Report Marco Verlato (INFN-Padova) INFN-GRID Testbed Meeting 17 Gennaio 2003.
29 May 2002Joint EDG/WP8-EDT/WP4 MeetingClaudio Grandi INFN Bologna LHC Experiments Grid Integration Plans C.Grandi INFN - Bologna.
Data Intensive Science Network (DISUN). DISUN Started in May sites: Caltech University of California at San Diego University of Florida University.
Claudio Grandi INFN Bologna CHEP'03 Conference, San Diego March 27th 2003 BOSS: a tool for batch job monitoring and book-keeping Claudio Grandi (INFN Bologna)
CPT Demo May Build on SC03 Demo and extend it. Phase 1: Doing Root Analysis and add BOSS, Rendezvous, and Pool RLS catalog to analysis workflow.
High Energy Physics and Grids at UF (Dec. 13, 2002)Paul Avery1 University of Florida High Energy Physics.
DataGrid is a project funded by the European Commission under contract IST F. Harris DataGrid EU Review 19 Feb 2004 WP8 HEP Applications Final.
US CMS Centers & Grids – Taiwan GDB Meeting1 Introduction l US CMS is positioning itself to be able to learn, prototype and develop while providing.
29/1/2002A.Ghiselli, INFN-CNAF1 DataTAG / WP4 meeting Cern, 29 January 2002 Agenda  start at  Project introduction, Olivier Martin  WP4 introduction,
29 Sept 2004 CHEP04 A. Fanfani INFN Bologna 1 A. Fanfani Dept. of Physics and INFN, Bologna on behalf of the CMS Collaboration Distributed Computing Grid.
August 30, 2002Jerry Gieraltowski Launching ATLAS Jobs to either the US-ATLAS or EDG Grids using GRAPPA Goal: Use GRAPPA to launch a job to one or more.
Alain Roy Computer Sciences Department University of Wisconsin-Madison Condor & Middleware: NMI & VDT.
December 26, 2015 RHIC/USATLAS Grid Computing Facility Overview Dantong Yu Brookhaven National Lab.
1 DataTAG-WP4 and GLUE ( mainly from A.Ghiselli II INFN-Grid workshop) Mirco Mazzucato Gridstart meeting at HPC Cetraro.
6 march Building the INFN Grid Proposal outline a.ghiselli,l.luminari,m.sgaravatto,c.vistoli INFN Grid meeting, milano.
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
1 Application status F.Carminati 11 December 2001.
Grid Activities in CMS Asad Samar (Caltech) PPDG meeting, Argonne July 13-14, 2000.
Planning Session. ATLAS(-CMS) End-to-End Demo Kaushik De is the Demo Czar Need to put team together Atlfast production jobs –Atlfast may be unstable over.
Summary of OSG Activities by LIGO and LSC LIGO NSF Review November 9-11, 2005 Kent Blackburn LIGO Laboratory California Institute of Technology LIGO DCC:
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
2 CMS 6 PB raw/run Phobos 50 TB/run E917 5 TB/run.
EDG Project Conference – Barcelona 13 May 2003 – n° 1 A.Fanfani INFN Bologna – CMS WP8 – Grid Planning in CMS Outline  CMS Data Challenges  CMS Production.
Massimo Sgaravatto INFN Padova
BaBar-Grid Status and Prospects
F Harris (OXFORD/CERN) Presented by I Augustin (CERN)
EDT-WP4 monitoring group status report
CMS report from FNAL demo week Marco Verlato (INFN-Padova)
Report on GLUE activities 5th EU-DataGRID Conference
Presentation transcript:

Claudio Grandi INFN Bologna DataTAG WP4 meeting, Bologna 14 jan 2003 CMS Grid Integration Claudio Grandi (INFN – Bologna)

Claudio Grandi INFN Bologna 14 jan 2003 DataTAG WP4 meeting, Bologna 2 CMS/EDG Stress Test Running from November 30 th to Xmas Sites: Official EDG Appl. testbed + RC + 4 dedicated RBs CMS sites: Legnaro, Poly, IC, CNAF Tier-1 About 350 CPU (RH 6.2) but not dedicated! Middleware: EDG release and (and added patches!) CMS task: FZ files production with IMPALA/BOSS: 2 steps: uses RC for input data location of CMSIM. No Objy (licenses)! Deliverables are big FZ files

Claudio Grandi INFN Bologna 14 jan 2003 DataTAG WP4 meeting, Bologna 3 CMS/EDG Stress Test ~7 sec/event average ~2.5 sec/event peak (12-14 dec)

Claudio Grandi INFN Bologna 14 jan 2003 DataTAG WP4 meeting, Bologna 4 USCMS IGT Production Running from October 25 th to Xmas Sites: Caltech, FNAL, UCSD, Uflorida About 230 CPU (RH 6.1) (+80 CPU at 2.4 GHz, RH 7.X) Middleware: VDT Globus, DAGMAN, Condor-G, EDG VO management scripts, Ganglia, MDS, Mona Lisa CMS task: Ntuple only productions with MOP: All steps in one job. No Objy data distributio Deliverables are small ntuples

Claudio Grandi INFN Bologna 14 jan 2003 DataTAG WP4 meeting, Bologna 5 USCMS IGT Production 4.7 sec/event average 2.5 sec/event peak (14-20 dec 2002)

Claudio Grandi INFN Bologna 14 jan 2003 DataTAG WP4 meeting, Bologna 6 Interoperability DataTAG/iVDGL activities for the demos: Interoperability between grid domains for applications submitted by users from different VOs EDG and VDT middleware coexist on resources sites in Europe and US (InterGRID) UI with Genius front-end submitting jobs using IMPALA/BOSS VDT client submitting jobs using MOP

Claudio Grandi INFN Bologna 14 jan 2003 DataTAG WP4 meeting, Bologna 7 InterGRID sites

Claudio Grandi INFN Bologna 14 jan 2003 DataTAG WP4 meeting, Bologna 8 Next steps Waiting for an EDG release compatible with DAGMan BOSS being modified to support DAG submission New modular CMS job-preparation tool: MCRunJob Born from MOP experience EDG plug-in (from CMS/EDG work) almost ready BOSS with R-GMA for fault-tolerance on WAN Evaluation of Chimera for Virtual Data