Download presentation
Presentation is loading. Please wait.
Published byJulian Henderson Modified over 8 years ago
1
ATLAS TIER3 in Valencia Santiago González de la Hoz IFIC – Instituto de Física Corpuscular (Valencia)
2
Santiago González de la Hoz, T3 Task Force 19-Oct-20072 Tier 3 prototype at IFIC Desktop Or Laptop (I) Atlas Collaboration Tier2 resources (Spanish T2) (II) ATLAS Tier3 resources (Institute) (II) Special requirements – PC farm to perform interactive analysis (III)
3
Santiago González de la Hoz, T3 Task Force 19-Oct-20073 Individual Desktop or Laptop Access to ATLAS software via AFS (Athena, root, atlantis, etc..) /afs/ific.uv.es/project/atlas/software/releases This is not easy, we have used the installation kit but this is not working for development or nightly releases Local checks, to develop analysis code before submitting larger jobs to the Tier1-2 via Grid Use the ATLAS Grid resources (UI) /afs/ific.uv.es/sw/LCG-share/sl3/etc/profile.d/grid_env.sh DQ2 installed at IFIC AFS /afs/ific.uv.es/sw/LCG-share/sl3/etc/profile.d/grid_env.sh Users could search data and copy them to the local SE. Ganga client installed /afs/ific.uv.es/project/atlas/software/ganga/install/etc/setup-atlas.sh Users can send jobs to the Grid for their analysis or production LXPLUSLXPLUS
4
Santiago González de la Hoz, T3 Task Force 19-Oct-20074 Phase (I) done From any PC at IFIC with AFS (i.e. 12.0.6) Requirements file at cmthome: #--------------------------------------------------------------------- set CMTSITE STANDALONE set SITEROOT /afs/ific.uv.es/project/atlas/software/releases macro ATLAS_DIST_AREA /afs/ific.uv.es/project/atlas/software/releases macro ATLAS_TEST_AREA ${HOME}/testarea apply_tag projectArea macro SITE_PROJECT_AREA ${SITEROOT} macro EXTERNAL_PROJECT_AREA ${SITEROOT} apply_tag setup apply_tag simpleTest use AtlasLogin AtlasLogin-* $(ATLAS_DIST_AREA) set CMTCONFIG i686-slc3-gcc323-opt set DBRELEASE_INSTALLED 3.1.1 #--------------------------------------------------------------------- Release test: source /afs/ific.uv.es/project/atlas/software/releases/CMT/v1r19/mgr/setup.sh cd $HOME/cmthome/ cmt config /usr/kerberos/bin/kinit -4 sgonzale@CERN.CH source ~/cmthome/setup.sh -tag=12.0.6,32 cd $HOME/testarea/12.0.6/ cmt co -r UserAnalysis-00-09-10 PhysicsAnalysis/AnalysisCommon/UserAnalysis cd PhysicsAnalysis/AnalysisCommon/UserAnalysis/cmt source setup.sh gmake
5
Santiago González de la Hoz, T3 Task Force 19-Oct-20075 Local SE STORM & Lustre GANGA Athena AOD Analysis ROOT/PROOF DPD or Ntuple Analysis -Ways to submit our jobs to other grid sites -Tools to transfer data -Work with ATLAS software -Use of final analysis tools (i.e. root) -User disk space
6
Santiago González de la Hoz, T3 Task Force 19-Oct-20076 Phase (II) resources coupled to Spanish ATLAS TIER2 (in progress) Nominal: ATLAS Collaboration resources: TB (SE) and CPU (WN) Tier2 Extra resources: WNs and SEs used only by Tier3 users Using different/share queues To run local and private production Production of MC samples of special interest for our institute (AOD for further analysis) To analyze AOD using GRID resources (AOD analysis on millions of events) To store interesting data for analysis
7
Santiago González de la Hoz, T3 Task Force 19-Oct-20077 Phase (III) a PC farm to perform interactive analysis outside Grid (it would be deployed) - Interactive analysis: DPD analysis (i.e. HightPTview, SAN, or AODroot..) - Install PROOF in a PC farm: - Parallel ROOT facility. System for interactive analysis of very large sets of ROOT data files (see Sergey’s slides on 5 th Oct) - Outside the Grid - 8-10 nodes - Fast Access to the data: Lustre and/or xrootd - Storm and Lustre under evaluation at IFIC - Xrootd (see Sergy’s slides) - Tier3 Grid and non-Grid resources are going to use the same SE
8
Santiago González de la Hoz, T3 Task Force 19-Oct-20078 StoRM Disk based SE Under evaluation Now using UnixfsSRM (dcache SRM version )for production in Tier2 Lustre in production in our Tier2 High performance file system Standard file system, easy to use Higher IO capacity due to the cluster file system Used in supercomputer centers Free version available www.lustre.org Hardware 2 clients for GridFTP and SRM 2 disk servers with 17 TB each one (34 TB in total)
9
Santiago González de la Hoz, T3 Task Force 19-Oct-20079 Athena analysis 12.0.6 AOD's 4 MB/s CPU limited and Athena Tests: RFIO without Castor
10
Santiago González de la Hoz, T3 Task Force 19-Oct-200710 The same test with DPD Both cases Lustre was used and data in the cache 1.8 MB/s with Root 340 MB/s with a simple “cat” 2 x Intel Xeon 3.06GHz 4 GBytes RAM 1 NIC Gigabit Ethernet HD: ST3200822AS (Using a 3Ware card: 8006-2LP)
11
Santiago González de la Hoz, T3 Task Force 19-Oct-200711 Summary From her/his desktop/laptop individual physicist can get access to: IFIC Tier2-Tier3 resources. ATLAS software (Athena, Atlantis, etc..), DDM/dq2 and Ganga tools. IFIC Tier3 resources will be split in two parts: Some resources coupled to IFIC Tier2 (ATLAS Spanish T2) in a Grid environment AOD analysis on millions of events geographically distributed. A PC farm to perform interactive analysis outside Grid To check and validate major analysis task before submitting them to large computer farms. A PROOF farm will be installed to do interactive analysis.
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.