CMS report from FNAL demo week Marco Verlato (INFN-Padova)

Slides:



Advertisements
Similar presentations
Claudio Grandi INFN Bologna DataTAG WP4 meeting, Bologna 14 jan 2003 CMS Grid Integration Claudio Grandi (INFN – Bologna)
Advertisements

DataTAG WP4 Meeting CNAF Jan 14, 2003 Interfacing AliEn and EDG 1/13 Stefano Bagnasco, INFN Torino Interfacing AliEn to EDG Stefano Bagnasco, INFN Torino.
Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.
ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.
Evaluation of the Globus Toolkit: Status Roberto Cucchi – INFN Cnaf Antonia Ghiselli – INFN Cnaf Giuseppe Lo Biondo – INFN Milano Francesco Prelz – INFN.
November 21, 2002Luca Vaccarossa INFN - Milano1 Interoperability Demos and Atlas applications Luca Vaccarossa (INFN - Milano) ATLAS Software Workshop 21/11/2002.
Grid and CDB Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
GRID workload management system and CMS fall production Massimo Sgaravatto INFN Padova.
27-29 September 2002CrossGrid Workshop LINZ1 USE CASES (Task 3.5 Test and Integration) Santiago González de la Hoz CrossGrid Workshop at Linz,
GRID Workload Management System Massimo Sgaravatto INFN Padova.
1 Use of the European Data Grid software in the framework of the BaBar distributed computing model T. Adye (1), R. Barlow (2), B. Bense (3), D. Boutigny.
First steps implementing a High Throughput workload management system Massimo Sgaravatto INFN Padova
Evaluation of the Globus GRAM Service Massimo Sgaravatto INFN Padova.
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
The EDG Testbed Deployment Details The European DataGrid Project
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
EDG - WP1 (Grid Work Scheduling) Status and plans Massimo Sgaravatto - INFN Padova Francesco Prelz – INFN Milano.
Grid Testbed Activities in US-CMS Rick Cavanaugh University of Florida 1. Infrastructure 2. Highlight of Current Activities 3. Future Directions NSF/DOE.
HEP Experiment Integration within GriPhyN/PPDG/iVDGL Rick Cavanaugh University of Florida DataTAG/WP4 Meeting 23 May, 2002.
KNMI Applications on Testbed 1 …and other activities.
STAR scheduling future directions Gabriele Carcassi 9 September 2002.
Computational grids and grids projects DSS,
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
05/23/2002Flavia Donno, INFN-Pisa1 DataTAG experiment grid integration plan Flavia Donno, INFN-Pisa DataTAG/iVDGL joint meeting, May 2002.
27-28 August 2002Flavia Donno, INFN-Pisa1 Report on GLUE activities Flavia Donno, INFN-Pisa EDG Retreat August 2002.
A monitoring tool for a GRID operation center Sergio Andreozzi (INFN CNAF), Sergio Fantinel (INFN Padova), David Rebatto (INFN Milano), Gennaro Tortone.
Grid Workload Management Massimo Sgaravatto INFN Padova.
CMS Stress Test Report Marco Verlato (INFN-Padova) INFN-GRID Testbed Meeting 17 Gennaio 2003.
C. Loomis – Integration Status- October 31, n° 1 Integration Status October 31, 2001
Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.
Author - Title- Date - n° 1 Partner Logo WP5 Summary Paris John Gordon WP5 6th March 2002.
29 May 2002Joint EDG/WP8-EDT/WP4 MeetingClaudio Grandi INFN Bologna LHC Experiments Grid Integration Plans C.Grandi INFN - Bologna.
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
Open Science Grid OSG CE Quick Install Guide Siddhartha E.S University of Florida.
TERENA 2003, May 21, Zagreb TERENA Networking Conference, 2003 MOBILE WORK ENVIRONMENT FOR GRID USERS. TESTBED Miroslaw Kupczyk Rafal.
University of Bristol 5th GridPP Collaboration Meeting 16/17 September, 2002Owen Maroney University of Bristol 1 Testbed Site –EDG 1.2 –LCFG GridPP Replica.
29/1/2002A.Ghiselli, INFN-CNAF1 DataTAG / WP4 meeting Cern, 29 January 2002 Agenda  start at  Project introduction, Olivier Martin  WP4 introduction,
December 26, 2015 RHIC/USATLAS Grid Computing Facility Overview Dantong Yu Brookhaven National Lab.
DataTAG: Glue schema test C.Vistoli DataTAG Wp4 Meeting 23/5/2002.
DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 1 GLUE Schema - Status Report DataTAG WP4 meeting Bologna,
1 DataTAG-WP4 and GLUE ( mainly from A.Ghiselli II INFN-Grid workshop) Mirco Mazzucato Gridstart meeting at HPC Cetraro.
K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python.
Summary from WP 1 Parallel Section Massimo Sgaravatto INFN Padova.
EDG - WP1 (Grid Work Scheduling) Status and plans Massimo Sgaravatto INFN Padova.
Open Science Grid Build a Grid Session Siddhartha E.S University of Florida.
TP: Grid site installation BEINGRID site installation.
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
WP1 Status and plans Francesco Prelz, Massimo Sgaravatto 4 th EDG Project Conference Paris, March 6 th, 2002.
Stephen Burke – Sysman meeting - 22/4/2002 Partner Logo The Testbed – A User View Stephen Burke, PPARC/RAL.
Planning Session. ATLAS(-CMS) End-to-End Demo Kaushik De is the Demo Czar Need to put team together Atlfast production jobs –Atlfast may be unstable over.
Bob Jones – Project Architecture - 1 March n° 1 Project Architecture, Middleware and Delivery Schedule Bob Jones Technical Coordinator, WP12, CERN.
II EGEE conference Den Haag November, ROC-CIC status in Italy
INFSO-RI Enabling Grids for E-sciencE Padova site report Massimo Sgaravatto On behalf of the JRA1 IT-CZ Padova group.
EDG Project Conference – Barcelona 13 May 2003 – n° 1 A.Fanfani INFN Bologna – CMS WP8 – Grid Planning in CMS Outline  CMS Data Challenges  CMS Production.
Massimo Sgaravatto INFN Padova
BaBar-Grid Status and Prospects
The EDG Testbed Deployment Details
U.S. ATLAS Grid Production Experience
INFNGRID Monitoring Group report
Workload Management System ( WMS )
Sergio Fantinel, INFN LNL/PD
The GENIUS portal Roberto Barbera University of Catania and INFN
A conceptual model of grid resources and services
5th EU DataGrid Conference
Report on GLUE activities 5th EU-DataGRID Conference
The EU DataGrid Fabric Management Services
GRID Workload Management System for CMS fall production
Presentation transcript:

CMS report from FNAL demo week Marco Verlato (INFN-Padova) DataTAG-WP4 meeting 8 October 2002 CMS report from FNAL demo week Marco Verlato (INFN-Padova)

iVDGL/DataTAG Demo Week at FNAL Demos: IST2002 4-6 November, Copenhagen SC2002 16-22 November, Baltimore Goals: Basic collaboration between European and US grid projects Interoperability between grid domains for applications submitted by users from different virtual organizations Controlled use of shared resources subject to agreed policy Integrated use of heterogeneous resources from iVDGL and EDG testbed domains

CMS specific interoperability Master Site FNAL IMPALA mop_submitter DAGMan Condor-G GDMP UFL VDT Server Batch Queue GDMP …add US & EU sites LB II EDG-CE/CloseSE Batch Queue GDMP EDG-UI PADOVA IMPALA GENIUS RB/JSS BOSS RC

From US to EU testbed DOESG certificates should be adopted by MOP master CMS software DAR installation needed on SE close to CE (and NFS mounted) MOP worker site configuration file to be sent to MOP master: (1-1) Stage-in/out jobmanger grid015.pd.infn.it/jobmanager-fork (SE) or grid011.pd.infn.it/jobmanager-lsf-datatag (CE) (1-2) GLOBUS_LOCATION=/opt/globus (1-3) Shared directory for mop files: /shared/cms/MOP (on SE and NFS exported to CE) (2-1) Run jobmanager: grid011.pd.infn.it/jobmanager-lsf-datatag (2-2) location of CMS DAR installation: /shared/cms/MOP/DAR, (3-1) GDMP install directory = /opt/edg (3-2) GDMP flat file directory = /shared/cms (3-3) GDMP Objectivity file directory (not needed for CMSIM production) (4-1) GDMP job manager: grid015.pd.infn.it/jobmanager-fork

From EU to US testbed VDT server acts as CE and SE in the same time VDT client installation required on batch worker nodes (WN’s) EDG certificates accepted by VDT servers (CE’s/SE’s) and clients (WN’s) CMS software EDG-1.2 rpm’s installed on VDT clients (WN’s) EDG Information Providers need to be installed on VDT server to be seen from RB Some additional data management EDG-1.2 tools, not included in VDT server/client packages, need to be installed to be able to use IMPALA_EDG as we do in EDT- CMS testbed: edg-compiler, classads, edg-replica-manager, BrokerInfo rpm’s some missing libglobus*dbg shared libraries Some modifications required to IMPALA_EDG to match with WN’s below private network and ldapsearch versions

First results Successful MOP submission from FNAL to EDG-CE/SE at PD (some minor problems for gdmp publication job) Successful IMPALA_EDG submission from EDG-UI at PD to VDT server at UFL (direct submission, no RB matchmaking) with output files registered to CMS Replica Catalogue CMS+EDG sw pacman-ized for US sites and rpm-ized for EU sites WEB pages set up with instructions and links to packages for preparing a site for demos Fruitful collaboration with CMS-US contacts (Anzar A. and Jorge R.) Daily phone meetings scheduled for keeping updated and plan further steps

Next steps Register VDT machines to II just set up for the demo Testing pacman and rpm cache installations Testing submission from EU to US+EU testbeds fully exploiting EDG-RB matchmaking capabilities Testing interoperability among different VO’s (submitting ATLAS jobs to CMS testbed and vice versa) Add more EU and US sites to demo testbed Finalize CMS-GENIUS interface to IMPALA_EDG: Work going in parallel with IMPALA_EDG refinements Implementing job tracking visualization through BOSS queries

CMS-GENIUS interface to IMPALA

CMS-GENIUS interface to IMPALA