11 September 2007Milos Lokajicek Institute of Physics AS CR Prague Status of the GRID in the Czech Republic NEC’2007.

Slides:



Advertisements
Similar presentations
1 PRAGUE site report. 2 Overview Supported HEP experiments and staff Hardware and software on Prague farms Brief statistics about running LHC experiments.
Advertisements

8 June 2000Atlas NCB CERN, M. Lokajicek1 Grid status in the Czech Republic zHEP Laboratories yAcademy of Sciences, Universities …. yparticipation to the.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Infrastructure overview Arnold Meijster &
Institute for High Energy Physics ( ) NEC’2007 Varna, Bulgaria, September Activities of IHEP in LCG/EGEE.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 15 th April 2009 Visit of Spanish Royal Academy.
Regional Computing Centre for Particle Physics Institute of Physics AS CR (FZU) TIER2 of LCG (LHC Computing Grid) 1M. Lokajicek Dell Presentation.
Tier 2 Prague Institute of Physics AS CR Status and Outlook J. Chudoba, M. Elias, L. Fiala, J. Horky, T. Kouba, J. Kundrat, M. Lokajicek, J. Svec, P. Tylka.
Large scale data flow in local and GRID environment V.Kolosov, I.Korolko, S.Makarychev ITEP Moscow.
Prague Site Report Jiří Chudoba Institute of Physics, Prague Hepix meeting, Prague.
1 A Basic R&D for an Analysis Framework Distributed on Wide Area Network Hiroshi Sakamoto International Center for Elementary Particle Physics (ICEPP),
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
Status Report on Tier-1 in Korea Gungwon Kang, Sang-Un Ahn and Hangjin Jang (KISTI GSDC) April 28, 2014 at 15th CERN-Korea Committee, Geneva Korea Institute.
ITEP participation in the EGEE project NEC’2005, Varna, Bulgaria Ivan Korolko (ITEP Moscow)
10 October 2006ICFA DDW'06, Cracow Milos Lokajicek, Prague 1 Current status and plans for Czech Grid for HEP.
Prague TIER2 Computing Centre Evolution Equipment and Capacities NEC'2009 Varna Milos Lokajicek for Prague Tier2.
Computing for ILC experiment Computing Research Center, KEK Hiroyuki Matsunaga.
Computing for HEP in the Czech Republic Jiří Chudoba Institute of Physics, AS CR, Prague.
Computing Infrastructure Status. LHCb Computing Status LHCb LHCC mini-review, February The LHCb Computing Model: a reminder m Simulation is using.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
29 June 2004Distributed Computing and Grid- technologies in Science and Education. Dubna 1 Grid Computing in the Czech Republic Jiri Kosina, Milos Lokajicek,
LCG Service Challenge Phase 4: Piano di attività e impatto sulla infrastruttura di rete 1 Service Challenge Phase 4: Piano di attività e impatto sulla.
Data management for ATLAS, ALICE and VOCE in the Czech Republic L.Fiala, J. Chudoba, J. Kosina, J. Krasova, M. Lokajicek, J. Svec, J. Kmunicek, D. Kouril,
MetaCentrum – the Czech computational grid Martin Kuba CESNET and Masaryk University Brno, Czech Republic.
Your university or experiment logo here Caitriana Nicholson University of Glasgow Dynamic Data Replication in LCG 2008.
March 2003 CERN 1 EDG and AliEn in Prague Dagmar Adamova INP Rez near Prague.
IST E-infrastructure shared between Europe and Latin America High Energy Physics Applications in EELA Raquel Pezoa Universidad.
GRID development in Russia 1) Networking for science and higher eductation 2) Grid for HEP 3) Digital Divide V. Ilyin SINP MSU.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 25 th April 2012.
Data transfer over the wide area network with a large round trip time H. Matsunaga, T. Isobe, T. Mashimo, H. Sakamoto, I. Ueda International Center for.
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
Tier-2  Data Analysis  MC simulation  Import data from Tier-1 and export MC data CMS GRID COMPUTING AT THE SPANISH TIER-1 AND TIER-2 SITES P. Garcia-Abia.
October 2002 INFN Catania 1 The (LHCC) Grid Project Initiative in Prague Dagmar Adamova INP Rez near Prague.
1 PRAGUE site report. 2 Overview Supported HEP experiments and staff Hardware on Prague farms Statistics about running LHC experiment’s DC Experience.
HEPIX - HEPNT, 1 Nov Milos Lokajicek, IP AS CR, Prague1 Status Report - Czech Republic HEP Groups and experiments Networking and Computing Grid activities.
Grid activities in the Czech Republic Jiří Kosina, Miloš Lokajíček, Jan Švec Institute of Physics of the Academy of Sciences of the Czech Republic
Tier2 Centre in Prague Jiří Chudoba FZU AV ČR - Institute of Physics of the Academy of Sciences of the Czech Republic.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America EELA Infrastructure (WP2) Roberto Barbera.
October 2006ICFA workshop, Cracow1 HEP grid computing in Portugal Jorge Gomes LIP Computer Centre Lisbon Laboratório de Instrumentação e Física Experimental.
The LHC Computing Grid – February 2008 The Challenges of LHC Computing Dr Ian Bird LCG Project Leader 6 th October 2009 Telecom 2009 Youth Forum.
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
Ian Bird LCG Deployment Area Manager & EGEE Operations Manager IT Department, CERN Presentation to HEPiX 22 nd October 2004 LCG Operations.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
7 March 2000EU GRID Project Proposal Meeting CERN, M. Lokajicek 1 Proposal for Participation of the Czech Republic in the EU HEP GRID Project Institute.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Large Simulations using EGEE Grid for the.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow UK-T0 Meeting 21 st Oct 2015 GridPP.
5 Sept 2006GDB meeting BNL, MIlos Lokajicek Service planning and monitoring in T2 - Prague.
Computing Jiří Chudoba Institute of Physics, CAS.
13 October 2004GDB - NIKHEF M. Lokajicek1 Operational Issues in Prague Data Challenge Experience.
Site Report: Prague Jiří Chudoba Institute of Physics, Prague WLCG GridKa+T2s Workshop.
Materials for Report about Computing Jiří Chudoba x.y.2006 Institute of Physics, Prague.
INFSO-RI Enabling Grids for E-sciencE The EGEE Project Owen Appleton EGEE Dissemination Officer CERN, Switzerland Danish Grid Forum.
IAG – Israel Academic Grid, EGEE and HEP in Israel Prof. David Horn Tel Aviv University.
Status of Tokyo LCG tier-2 center for atlas / H. Sakamoto / ISGC07 Status of Tokyo LCG Tier 2 Center for ATLAS Hiroshi Sakamoto International Center for.
Computing for HEP in the Czech Republic Jiří Chudoba Institute of Physics, AS CR, Prague.
BNL dCache Status and Plan CHEP07: September 2-7, 2007 Zhenping (Jane) Liu for the BNL RACF Storage Group.
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
Victoria A. White Head, Computing Division, Fermilab Fermilab Grid Computing – CDF, D0 and more..
Status of GSDC, KISTI Sang-Un Ahn, for the GSDC Tier-1 Team
Dominique Boutigny December 12, 2006 CC-IN2P3 a Tier-1 for W-LCG 1 st Chinese – French Workshop on LHC Physics and associated Grid Computing IHEP - Beijing.
Activities and Perspectives at Armenian Grid site The 6th International Conference "Distributed Computing and Grid- technologies in Science and Education"
INFSO-RI Enabling Grids for E-sciencE Turkish Tier-2 Site Report Emrah AKKOYUN High Performance and Grid Computing Center TUBITAK-ULAKBIM.
Tier2 Centre in Prague Jiří Chudoba FZU AV ČR - Institute of Physics of the Academy of Sciences of the Czech Republic.
The status of IHEP Beijing Site WLCG Asia-Pacific Workshop Yaodong CHENG IHEP, China 01 December 2006.
Grid activities in Czech Republic Jiri Kosina Institute of Physics of the Academy of Sciences of the Czech Republic
13 January 2004GDB Geneva, Milos Lokajicek Institute of Physics AS CR, Prague LCG regional centre in Prague
COMPUTING FOR ALICE IN THE CZECH REPUBLIC in 2016/2017
LHC Data Analysis using a worldwide computing grid
This work is supported by projects Research infrastructure CERN (CERN-CZ, LM ) and OP RDE CERN Computing (CZ /0.0/0.0/1 6013/ ) from.
Presentation transcript:

11 September 2007Milos Lokajicek Institute of Physics AS CR Prague Status of the GRID in the Czech Republic NEC’2007

11 September 2007NEC'20072 Outline CZ pre-grid activities Grid activities Grid status –Networking –Distributed Tier2 center and its performance Conclusions

11 September 2007NEC'20073 CZ pre-grid activities Synergy of the Czech pre-grid activities in 90ties –Particle Physics –MetaCentrum Project –CESNET Particle physics active collaboration –DELPHI experiment on LEP at CERN –H1 experiment on HERA at DESY –Several smaller experiments –Collaboration groups Institutes of the Academy of Sciences of the Czech Republic Charles University in Prague Czech Technical University in Prague

11 September 2007NEC'20074 CZ pre-grid activities MetaCentrum Project –Collaboration of the Czech universities supercomputing centers –Create single computing environment for academic users –Single user login, same user interfaces and application interfaces independent on HW or OS –Single queuing system –OpenAFS Kerberized system, same authentication credentials –Originally Masaryk University in Brno, West Bohemia University in Plzen and Charles university in Prague –Now project of CESNET with contribution of Universities –Resources in 4 sites 1000 CPUs, mainly IA-32/64 architecture, Tens of TB disk space, tape archives in Plzen and Brno –Partner to international EGEE and EGI_DS (European Grid Initiative Design Study), national MediGRID project

11 September 2007NEC'20075 CZ pre-grid activities CESNET Czech scientific research network provider 1992 first ip line to Austria 1993 country-wide backbone network connecting 8 cities Member/stake holder of all important European network activities Today legal structure: Association of legal bodies created by Academy of Sciences of the Czech Republic and Czech Universities Connects all Czech Universities with high bandwidth network Current charge of CESNET –Research network, novel application over network, grid activities

11 September 2007NEC'20076 Grid activities Preparation of LHC project –Monarch project at CERN, widelly distributed hierarchical model –CHEP conference in Padova 2000 Reached agreement in HEP community of grid –EDG (European DataGRID) from 2001 And other parallel grid projects Similar situation in U.S.A. –Czech Republic (CESNET and Institute of Physics AS CR) took part from beginning Testbed and HEP applicaton, Logging and bookkeeping of the Workload management package –EGEE, EGEEII, … EGEEIII, EGI Design Study, CESNET as partner Preparation of local NGI (National Grid Initiative) – a tough task –LCG, WLCG – participation via Institute of Physics AS CR –Distributed TIER 2 center in Prague

11 September 2007NEC'20077 Grid Status Distributed TIER 2 center in Prague –Golias farm Institute of Physics AS CR –Skurut farm CESNET EGEEII –Pre/Production services –Reengineering – logging and bookkeeping, job provenance –VOCE – Central Europe Federation VO Proposed by CESNET Running it main services All purpose research VO for CE –AUGER VO support

11 September 2007NEC'20078 Grid Status Networking CESNET2 network –Integrated to GEANT2 –Highly reliable backbone of redundant circles of dark fibers –Cross-boarder connections

11 September 2007NEC'20079 Grid Status Special 1 Gbps infrastructure for HEP GLIF –Prague – FNAL D0 –Prague – Taipei ATLAS Tier1 –Prague - BNL soon in production GN –Prague – FZK ATLAS Tier1 GLIF GN2 Local 10/1 Gbps infrastructure in Prague –Collaborating groups in Academy of Sciences –Charles and Czech Technical Universities in Prague

11 September 2007NEC' TIER2 distributed center performance

11 September 2007NEC' TIER2 distributed center performance End 2007 capacities Main usage –D0 experiment simulations and reconstruction 50% –ATLAS, ALICE, STAR, VOCE, Auger computing, solid state physics –Support for VO: VOCE, Auger Preproduction and Preview testbeds Computing capacity kSI2k Number of coresDisk capacity TB GOLIAS SKURUT3038Shared from Golias

11 September 2007NEC' TIER2 distributed center performance Contribution to the D0 experiment 0.5 M events per week in 2006/ rd biggest contribution to simulations

11 September 2007NEC' TIER2 distributed center performance DPM transfer test Prague to Taipei 1 Gbps line, RTT 310ms, 50 streams per file, 10 files in parallel, size of file 1 GB, tcp buffer 100 MB 1 hour test, average 31 MB/s, maximum 53 MB/s Transfer Taipei to Prague only 20 MB/s, problems with Prague servers stability, further test ongoing

11 September 2007NEC' TIER2 distributed center performance Should be compared with FZK Karlsruhe to Prague transfer 1 Gbps line, 10 streams per file, 10 files in parallel, file size 1 GB, tcp buffer default value 5 hour test, average 48 MB/s, maximum 75 MB/s

11 September 2007NEC' TIER2 distributed center performance Monitoring – key for reliable service –both standard grid monitoring and local HW, SW and services monitoring Local monitoring (Talk of Tomas Kouba) –Nagios – various plugins and workarounds –Interface for dynamic configuraton of nagios according to our HW and SW database –Reduction of nagios warning Critical nagios warnings – distributed immediatelly Other warnings – summarized in a developped digest and distributed 3 times per day only

11 September 2007NEC' Conclusions Czech Republic – partner of EU grid projects from 2001 Activities both in grid deployment and reengineering Middle sized distributed TIER2 center fully integrated into EGEE/LCG environment –Delivery of well visible computing services to experiments and projects –Data transfer services over special lines –Support of VOs VOCE and Auger –Active contribution for reengineering – logging and bookkeeping and recently job provenance All this is supported by excellent quality of CESNET2 network and special E2E lines both local and international Taking part in preparation EGEEIII and EGI projects Big effort will be needed to create Czech NGI