CMS OSG Motivation and Introduction Overview

Slides:



Advertisements
Similar presentations
Open Science Grid Discovering and understanding the site environment Or, yet another site test kit.
Advertisements

05/11/2001 CPT week Natalia Ratnikova, FNAL 1 Software Distribution in CMS Distribution unitFormContent Version of SCRAM managed project.
CERN LCG Overview & Scaling challenges David Smith For LCG Deployment Group CERN HEPiX 2003, Vancouver.
CMS Applications Towards Requirements for Data Processing and Analysis on the Open Science Grid Greg Graham FNAL CD/CMS for OSG Deployment 16-Dec-2004.
Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Team: Maya Zalcberg Diana Attar Levona Hershtik Academic advisor: Prof. Ehud Gudes ADD Presentation.
Workload Management Workpackage Massimo Sgaravatto INFN Padova.
Workload Management Massimo Sgaravatto INFN Padova.
Member of the ExperTeam Group Ralf Ratering Pallas GmbH Hermülheimer Straße Brühl, Germany
CVMFS: Software Access Anywhere Dan Bradley Any data, Any time, Anywhere Project.
Computing at COSM by Lawrence Sorrillo COSM Center.
SCRAM Software Configuration, Release And Management Background SCRAM has been developed to enable large, geographically dispersed and autonomous groups.
SUSE Linux Enterprise Server Administration (Course 3037) Chapter 4 Manage Software for SUSE Linux Enterprise Server.
OSG Public Storage and iRODS
1 Dynamic Application Installation (Case of CMS on OSG) Introduction CMS Software Installation Overview Software Installation Issues Validation Considerations.
OSG Services at Tier2 Centers Rob Gardner University of Chicago WLCG Tier2 Workshop CERN June 12-14, 2006.
OSG Site Provide one or more of the following capabilities: – access to local computational resources using a batch queue – interactive access to local.
J.T Moscicki CERN LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Software Packaging and Distribution LCG Application.
Daniel Vanderster University of Victoria National Research Council and the University of Victoria 1 GridX1 Services Project A. Agarwal, A. Berman, A. Charbonneau,
Grid Job and Information Management (JIM) for D0 and CDF Gabriele Garzoglio for the JIM Team.
OSG Middleware Roadmap Rob Gardner University of Chicago OSG / EGEE Operations Workshop CERN June 19-20, 2006.
Grid Computing, B. Wilkinson, b.1 National Science Foundation Middleware Initiative (NMI) Started in 2001 initially over 3 years “to create and deploy.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
Contents 1.Introduction, architecture 2.Live demonstration 3.Extensibility.
Status of the LHCb MC production system Andrei Tsaregorodtsev, CPPM, Marseille DataGRID France workshop, Marseille, 24 September 2002.
The Grid computing Presented by:- Mohamad Shalaby.
OSG Tier 3 support Marco Mambelli - OSG Tier 3 Dan Fraser - OSG Tier 3 liaison Tanya Levshina - OSG.
T3 analysis Facility V. Bucard, F.Furano, A.Maier, R.Santana, R. Santinelli T3 Analysis Facility The LHCb Computing Model divides collaboration affiliated.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
Site Validation Session Report Co-Chairs: Piotr Nyczyk, CERN IT/GD Leigh Grundhoefer, IU / OSG Notes from Judy Novak WLCG-OSG-EGEE Workshop CERN, June.
CERN IT Department t LHCb Software Distribution Roberto Santinelli CERN IT/GS.
The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no Workflow repository, user.
Korea Workshop May GAE CMS Analysis (Example) Michael Thomas (on behalf of the GAE group)
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
CMS Usage of the Open Science Grid and the US Tier-2 Centers Ajit Mohapatra, University of Wisconsin, Madison (On Behalf of CMS Offline and Computing Projects)
1 CMS Software Installation, Bockjoo Kim, 23 Oct. 2008, T3 Workshop, Fermilab CMS Commissioning and First Data Stan Durkin The Ohio State University for.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
D.Spiga, L.Servoli, L.Faina INFN & University of Perugia CRAB WorkFlow : CRAB: CMS Remote Analysis Builder A CMS specific tool written in python and developed.
II EGEE conference Den Haag November, ROC-CIC status in Italy
OSG Status and Rob Gardner University of Chicago US ATLAS Tier2 Meeting Harvard University, August 17-18, 2006.
Geant4 GRID production Sangwan Kim, Vu Trong Hieu, AD At KISTI.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Klaus Rabbertz Berlin, Jahrestagung der DPG 1 CMS Software Installation Andreas Nowack Shahzad Muzaffar Andrea Sciabà Stephan Wynhoff Klaus.
Introduction to Oracle Forms Developer and Oracle Forms Services
Workload Management Workpackage
Simulation Production System
NA4/medical imaging. Medical Data Manager Installation
Overview of the Belle II computing
How to connect your DG to EDGeS? Zoltán Farkas, MTA SZTAKI
Introduction to Oracle Forms Developer and Oracle Forms Services
ETICS Pool for IPv6 tests
Grid2Win: Porting of gLite middleware to Windows XP platform
Introduction to Oracle Forms Developer and Oracle Forms Services
Introduction to Grid Technology
GLAST Release Manager Automated code compilation via the Release Manager Navid Golpayegani, GSFC/SSAI Overview The Release Manager is a program responsible.
LCG Monte-Carlo Events Data Base: current status and plans
Interoperability & Standards
LCG middleware and LHC experiments ARDA project
SCL, Institute of Physics Belgrade, Serbia
Leigh Grundhoefer Indiana University
DRM Deployment Readiness Plan
Initial job submission and monitoring efforts with JClarens
Module 01 ETICS Overview ETICS Online Tutorials
Alice Software Demonstration
From Prototype to Production Grid
The EU DataGrid Fabric Management Services
GRID Workload Management System for CMS fall production
Presentation transcript:

CMS Software Installation on OSG An OSG USE Case and USCMS Software Management on OSG CMS OSG Motivation and Introduction Overview CMS Software Installation Tool OSG Auth+Monitoring Implementation Status of CMS Installation on OSG Summary and Prospects Presented by Bockjoo Kim for USCMS DCT Demo at OSG Consortium Meeting

Motivation and Introduction The Grid can provide computing resources and storages with great flexibility The same software can be installed without publication and notification This type of activity could be organized and managed in a consistent manner, one could efficiently use the grid resources. This presentation demonstrates how CMS software that is used by the CMS collaboration for physics analyses can be installed, maintained, and published on OSG in a managed way Demo at OSG Consortium Meeting

An Overview of CMS Software Deployment on OSG CSD-GUI : Persistent Grid GridCat Client MySQL DB CMS Grid Users GridCat Deploy Scripts Local Scripts Submit Condor-G Grid Middle Ware Local Scripts $app CMSI Tool Discovery Service RPMs A Remote Site CSD-GUI OSG IS CMSI Tool RPMs CMS IS CMS CMSI Repository Demo at OSG Consortium Meeting

CMS Software Installation Tool is used to install CMS xcmsi is a tool to install CMS software written in PERL Arbitrary installation directory $CMS_PATH to relocate RPM packages No root privileges required Typically 1 GCC compiler, 1 SCRAM (Soft. Management Tool), ~40 CMS RPMs, ~30 LCG RPMs. ~4 GB space Essential ingredients to the installation are the RPMs Demo at OSG Consortium Meeting

A Schematic of OSG Authorization and Resources Demo at OSG Consortium Meeting

Implementation of CSD-GUI (CMS Software Deployment Grid User Interface for USCMS) HTTPS MySQL voms proxy globus client CGI OSG Client/Condor-G GUI script(python) GridCat Client condor_submit/condor_q undo upload. csd upload condor_q/rm undo install. csd install. undo verify csd verify create info file Installation Table check arch Execution Scripts Site Info. Demo at OSG Consortium Meeting

Demo at OSG Consortium Meeting CSD-GUI Features Managed Software Installation Persistent Installation Task Installation Control Using X509 Proxy Installation Bookkeeping Using MySQL Publish Installation Info in Text Switch Between OSG-ITB and OSG Undo only in MySQL Operation Non-DAG/Single Job Submission for Success Easy to Add New Scripts Demo at OSG Consortium Meeting

Demo at OSG Consortium Meeting CSD-GUI Demo at OSG Consortium Meeting

Status of CMS Installation on OSG # Sites OSG/OSG-ITB 5 Since June 16, 2005 4 3 2 1 CMKIN_4_0_0 CMKIN_5_0_0 CMKIN_5_1_0 OSCAR_3_7_0 OSCAR_3_9_4 OSCAR_3_9_5 ORCA_8_6_0 ORCA_8_7_3 ORCA_8_9_0 CMS Software Demo at OSG Consortium Meeting

Issues of CMS Installation on OSG Missing System Software (perl modules) Special $app Directory No wget Network Insulated WN GLIBC Inconsistency Validation is non-trivial (Help from MCPS (see demo) and Physics Analysis) Demo at OSG Consortium Meeting

Demo at OSG Consortium Meeting Summary and Prospects Managed/Persistent CMS software installation (18) has been performed on OSG Local Installation Information for Discovery Service We will expand the installation Non-trivial Sites to be handled with different methods Use MCPS and Real Physics Analysis for Validation Demo at OSG Consortium Meeting