Data Processing for CDF Computing Feb. 23~28, 2009 APCTP-2009 YongPyong, Korea Data Processing for CDF Computing Minho Jeung, Hyunwoo Kim and Kihyeon Cho* (http://hep.kisti.re.kr) * Corresponding author April 25, 2019
The CDF Collaboration Europe 21 institutions North America France group, LPNHE/ CNRS-IN2P3&UPMC and ParisVII Universities North America 34 institutions Asia 8 institutions Korea group, KISTI, Chonnam, KNU, SNU, SKKU The CDF Collaboration 15 Countries 63 institutions 635 authors 2
Accelerator & CDF performance Tevatron is the world highest energy accelerator at S=1.96 TeV. CDF will be able to take data until to 2010. Data processing and analysis will be done five more years after that. Data taken 4.1 fb-1 (Nov. 2008) 5~6 fb-1 till by 2009
Network between Korea-Fermilab GLORIAD ESNet Mathis Equation BW: Upper bound of TCP throughput MSS: Max Segment Size RTT: Round Trip Time P: Packet Loss Nov. 2005 vs. Jan. 2009
CHEP(Korea) – Fermilab Nov. 10~24, 2005 (2 weeks) Packet loss is low. RTT is unstable. 2019년 4월 25일
Networks between KISTI and abroad (Jan. 2009) KEK GLORIAD-KR/10Gbps Hong Kong CSTNet-APAN-JP/1Gbps Fermilab Seattle ESnet/10Gbps CERN/ IN2P3 GLORIAD/1Gbps Chicago StarLight/10Gbps KISTI KISTI-Fermilab directly via Seattle (not via Chicago) 2019년 4월 25일
KISTI-Fermilab Jan. 6~20, 2009 (2 weeks) Packet loss is zero. RTT is stable. We avoid Chicago area congestions by direct network from Seattle. 2019년 4월 25일
KISTI-CERN Jan. 6~20, 2009 (2 weeks) Packet loss is zero. RTT is stable. 2019년 4월 25일
KISTI-IN2P3 Jan. 6~20, 2009 (2 weeks) Packet loss is zero. RTT is stable. 2019년 4월 25일
CDF Farms around world CAF (2001) DCAF (2003) Grid CAF (2006) CGCC (2008) UCSD CAF Toronto CAF Rut CAF Lyon CAF Taiwan AS BCN CAF CNAF CAF Korean CAF : KISTI, KNU Japan CAF European CAF Pacific North American Tsukuba U ASGC, Taiwan KISTI KNU 11 11
Progress of CDF Farms 12 Name Starting Date Grid middleware Job scheduling Content Site CAF 2001 - Condor Cluster farm inside Fermilab USA (Fermilab) DCAF 2003 Cluster farm outside Fermilab Korea, Japan, Taiwan, Spain (Varcelona, Cantabria), USA (Rutgers, San Diego), Canada, France Grid CAF 2006 LCG/OSG Resource Broker, Grid farm North America CAF European CAF Pacific CAF CGCC (CDF Grid Computing Center) 2008 LCG Big Grid farm Korea (KISTI) France (IN2p3) Italy (CNAF) 12 12
Grid CAF Context Diagram of Grid CAF Grid Farm (European CAF) Grid Farm (North America CAF) User Interface Grid Farm (Pacific CAF) CAF GUI Grid Site (IPAS_OSG) Grid Site (Taiwan-LCG2 ) Grid Site (KR-KISTI-HEP) Grid Site (JP-TSUKUBA) Grid Site (IPAS_CS) Legend Service Component Grid CAF Boundary Grid Site Boundary Job Transport Grid Pool 13 13
The comparison of Grid CAF Head node Work node Grid Middleware Method VO (Virtual Organization) North America CAF Fermilab (USA) USSD (USA) etc OSG Condor over Globus CDF VO European CAF CNAF (Italia) IN2P3 (France) Etc LCG WMS (Workload Management System) Pacific CAF AS (Taiwan) KISTI (Korea) LCG, OSG 14 14
Grid Site (KR-KISTI-HEP) Grid Farm (Pacific CAF) Pacific CAF at KISTI Service Component Legend Repository Grid CAF Boundary Grid Site Boundary Grid Pool Job Data Transportation Control Data Grid Site (KR-KISTI-HEP) Worker Node (hep015) … (hep004) Work Node (hep003) dCache Pool (se-hep) Grid Farm (Pacific CAF) VOMS Authentication Glideins dCache User Interface CafGui CafSubmit CafMon CAF Head Node Submitter Monitor Collector Negotiator Schedd Globus .... Job Submission Web monitoring Job Output Condor CE (hep001) 25 core processors 30 T Byte 15 15
Monitoring of Pacific CAF 16 16
Monitoring of Pacific CAF 17 17
HEP Computing farms in Korea
Jobs / CPU time per VO Jobs / VO Jan.-Nov. 2008 CPU time / VO
CDF Resource Usage - Total Ref. Dr. Donatella Lucchesi
Offsite Usage – USA & Asia => CGCC (CDF Grid Computing Center) Donatella clearly mentioned about KISTI in International Finance Committee Meeting on November ’08. Ref. Prof. DongHee Kim
CDF Grid Computing Center (CGCC) A hardware allocation plan for CGCC Pacific CAF at KISTI CGCC at KISTI Head node paccaf.phys.sinica.edu.tw New Head node VOMS server voms.cnaf.infn.it New VOMS server Work nodes 25 core processes 400 core processes Storage 30 T byte 300 T byte 22 22
Summary Data processing for CDF has been developed from CAF (Central Analysis Farm) to Grid. KISTI is one of leading institutes of CDF data processing.
Thank you. (http://hep.kisti.re.kr)