Global Science experimental Data hub Center April 25, 2016 Seo-Young Noh Status Report on KISTI’s Computing Activities.

Slides:



Advertisements
Similar presentations
Exporting Raw/ESD data from Tier-0 Tier-1s Wrap-up.
Advertisements

Update on Status of Tier-1 GSDC, KISTI Sang-Un Ahn, for the GSDC Tier-1 Team
Status GridKa & ALICE T2 in Germany Kilian Schwarz GSI Darmstadt.
T1 at LBL/NERSC/OAK RIDGE General principles. RAW data flow T0 disk buffer DAQ & HLT CERN Tape AliEn FC Raw data Condition & Calibration & data DB disk.
Tier 2 Prague Institute of Physics AS CR Status and Outlook J. Chudoba, M. Elias, L. Fiala, J. Horky, T. Kouba, J. Kundrat, M. Lokajicek, J. Svec, P. Tylka.
Ian M. Fisk Fermilab February 23, Global Schedule External Items ➨ gLite 3.0 is released for pre-production in mid-April ➨ gLite 3.0 is rolled onto.
March 27, IndiaCMS Meeting, Delhi1 T2_IN_TIFR of all-of-us, for all-of-us, by some-of-us Tier-2 Status Report.
Stefano Belforte INFN Trieste 1 CMS SC4 etc. July 5, 2006 CMS Service Challenge 4 and beyond.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
Status Report on Tier-1 in Korea Gungwon Kang, Sang-Un Ahn and Hangjin Jang (KISTI GSDC) April 28, 2014 at 15th CERN-Korea Committee, Geneva Korea Institute.
Global Science experiment Data hub Center Oct. 13, 2014 Seo-Young Noh Status Report on Tier 1 in Korea.
CC - IN2P3 Site Report Hepix Fall meeting 2009 – Berkeley
SC4 Workshop Outline (Strong overlap with POW!) 1.Get data rates at all Tier1s up to MoU Values Recent re-run shows the way! (More on next slides…) 2.Re-deploy.
BINP/GCF Status Report BINP LCG Site Registration Oct 2009
Ian Bird LHCC Referee meeting 23 rd September 2014.
11 ALICE Computing Activities in Korea Beob Kyun Kim e-Science Division, KISTI
Take on messages from Lecture 1 LHC Computing has been well sized to handle the production and analysis needs of LHC (very high data rates and throughputs)
CHEP'07 September D0 data reprocessing on OSG Authors Andrew Baranovski (Fermilab) for B. Abbot, M. Diesburg, G. Garzoglio, T. Kurca, P. Mhashilkar.
November 16, 2012 Seo-Young Noh Haengjin Jang {rsyoung, Status Updates on STAR Computing at KISTI.
LCG Service Challenge Phase 4: Piano di attività e impatto sulla infrastruttura di rete 1 Service Challenge Phase 4: Piano di attività e impatto sulla.
14 Aug 08DOE Review John Huth ATLAS Computing at Harvard John Huth.
Sejong STATUS Chang Yeong CHOI CERN, ALICE LHC Computing Grid Tier-2 Workshop in Asia, 1 th December 2006.
Status Report of WLCG Tier-1 candidate for KISTI-GSDC Sang-Un Ahn, for the GSDC Tier-1 Team GSDC Tier-1 Team 12 th CERN-Korea.
CERN Physics Database Services and Plans Maria Girone, CERN-IT
1 Lecture # 21 Evolution of Internet. 2 Circuit switching network This allows the communication circuits to be shared among users. E.g. Telephone exchange.
LCG Introduction John Gordon, STFC-RAL GDB September 9 th, 2008.
COMSATS Institute of Information Technology, Islamabad PK-CIIT Grid Operations in Pakistan COMSATS Dr. Saif-ur-Rehman Muhammad Waqar Asia Tier Center Forum.
KISTI-GSDC SITE REPORT Sang-Un Ahn, Jin Kim On the behalf of KISTI GSDC 24 March 2015 HEPiX Spring 2015 Workshop Oxford University, Oxford, UK.
Ian Bird LHC Computing Grid Project Leader LHC Grid Fest 3 rd October 2008 A worldwide collaboration.
The LHC Computing Grid – February 2008 The Challenges of LHC Computing Dr Ian Bird LCG Project Leader 6 th October 2009 Telecom 2009 Youth Forum.
KISTI-GSDC SITE REPORT Asia Tier Center KISTI, Daejeon, South Korea 22 Sep – 24 Sep 2015 Sang-Un Ahn on the behalf of KISTI-GSDC.
CERN IT Department CH-1211 Genève 23 Switzerland t Frédéric Hemmer IT Department Head - CERN 23 rd August 2010 Status of LHC Computing from.
Status Report of WLCG Tier-1 candidate for KISTI-GSDC Sang-Un Ahn, for the GSDC Tier-1 Team GSDC Tier-1 Team ATHIC2012, Busan,
CMS Computing Model Simulation Stephen Gowdy/FNAL 30th April 2015CMS Computing Model Simulation1.
SLACFederated Storage Workshop Summary For pre-GDB (Data Access) Meeting 5/13/14 Andrew Hanushevsky SLAC National Accelerator Laboratory.
BNL Service Challenge 3 Status Report Xin Zhao, Zhenping Liu, Wensheng Deng, Razvan Popescu, Dantong Yu and Bruce Gibbard USATLAS Computing Facility Brookhaven.
Content: India’s e-infrastructure an overview The Regional component of the Worldwide LHC Computing Grid (WLCG ) India-CMS and India-ALICE Tier-2 site.
Procedure to follow for proposed new Tier 1 sites Ian Bird CERN, 27 th March 2012.
US-CMS T2 Centers US-CMS Tier 2 Report Patricia McBride Fermilab GDB Meeting August 31, 2007 Triumf - Vancouver.
Procedure for proposed new Tier 1 sites Ian Bird WLCG Overview Board CERN, 9 th March 2012.
Introduction to Asia Tier Center Forum Seo-Young Noh GSDC, KISTI.
Tier-1 Andrew Sansum Deployment Board 12 July 2007.
Doug Benjamin Duke University. 2 ESD/AOD, D 1 PD, D 2 PD - POOL based D 3 PD - flat ntuple Contents defined by physics group(s) - made in official production.
Andrea Manzi CERN On behalf of the DPM team HEPiX Fall 2014 Workshop DPM performance tuning hints for HTTP/WebDAV and Xrootd 1 16/10/2014.
STATUS OF KISTI TIER1 Sang-Un Ahn On behalf of the GSDC Tier1 Team WLCG Management Board 18 November 2014.
DJ: WLCG CB – 25 January WLCG Overview Board Activities in the first year Full details (reports/overheads/minutes) are at:
JINR WLCG Tier 1 for CMS CICC comprises 2582 Core Disk storage capacity 1800 TB Availability and Reliability = 99% 49% 44% JINR (Dubna)End of.
Eygene Ryabinkin, on behalf of KI and JINR Grid teams Russian Tier-1 status report May 9th 2014, WLCG Overview Board meeting.
Dynamic staging to a CAF cluster Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,
Data transfers and storage Kilian Schwarz GSI. GSI – current storage capacities vobox LCG RB/CE GSI batchfarm: ALICE cluster (67 nodes/480 cores for batch.
Development of a Tier-1 computing cluster at National Research Centre 'Kurchatov Institute' Igor Tkachenko on behalf of the NRC-KI Tier-1 team National.
LHC Computing in Korea Seyong Kim For the 1 st Korea-CERN meeting.
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
Meeting with University of Malta| CERN, May 18, 2015 | Predrag Buncic ALICE Computing in Run 2+ P. Buncic 1.
Status of GSDC, KISTI Sang-Un Ahn, for the GSDC Tier-1 Team
Dominique Boutigny December 12, 2006 CC-IN2P3 a Tier-1 for W-LCG 1 st Chinese – French Workshop on LHC Physics and associated Grid Computing IHEP - Beijing.
KISTI activities and plans Global experiment Science Data hub Center Jin Kim LHCOPN-ONE Workshop in Taipei1.
IHEP Computing Center Site Report Gang Chen Computing Center Institute of High Energy Physics 2011 Spring Meeting.
Grid technologies for large-scale projects N. S. Astakhov, A. S. Baginyan, S. D. Belov, A. G. Dolbilov, A. O. Golunov, I. N. Gorbunov, N. I. Gromova, I.
ATLAS Computing: Experience from first data processing and analysis Workshop TYL’10.
Pledged and delivered resources to ALICE Grid computing in Germany Kilian Schwarz GSI Darmstadt ALICE Offline Week.
KISTI-GSDC SITE REPORT KoALICE National ARPINA, Busan, South Korea 8 April – 10 April 2016 Sang-Un Ahn on the behalf of KISTI-GSDC.
Grid Operations in Germany T1-T2 workshop 2015 Torino, Italy Kilian Schwarz WooJin Park Christopher Jung.
GSDC: A Unique Data Center in Korea for Fundamental Research Global Science experimental Data hub Center Korea Institute of Science and Technology Information.
Dynamic Extension of the INFN Tier-1 on external resources
2nd Asia Tier Centre Forum Summary report 4th April 2017 edoardo
October 28, 2013 at 14th CERN-Korea Committee, Geneva
Update on Plan for KISTI-GSDC
KISTI-GSDC Tier-1 SITE REPORT
Ákos Frohner EGEE'08 September 2008
Presentation transcript:

Global Science experimental Data hub Center April 25, 2016 Seo-Young Noh Status Report on KISTI’s Computing Activities

Status Report on KISTI’s Computing Activities2/18CKC Meeting, April 25, 2016 Contents 1.WLCG Tier-1 Status 2.KiAF, CMS 3.Plans (Network & CMS Tier-2) 4.Conclusions

WLCG Tier-1 Status

Status Report on KISTI’s Computing Activities4/18CKC Meeting, April 25, 2016 WLCG Tier-1 Infrastructure 3,488 Job slots, 3PB Storage, 10Gbps fully connected Services SAN-based Storage KISTI  CERN Network Performance Monitoring Lightweight workloads performed by virtual machines Lightweight workloads performed by virtual machines

Status Report on KISTI’s Computing Activities5/18CKC Meeting, April 25, 2016 Computing Jobs Max 3,488 concurrent jobs (84 nodes x 32 cores, 10.5 HS06/core) (20 nodes x 40 cores, 11.4 HS06/core) = 37 kHS06 Meet the pledge of 2016 ~ 2500 More than 2.61 million jobs during last 6 months KISTI, 3.19% ~ 3300 Special Requests from ALICE, 3GB/job → 6GB/job KISTI Tier-1 has been providing reliable and stable service Reduced the computing slots into half

Status Report on KISTI’s Computing Activities6/18CKC Meeting, April 25, 2016 Storage(Disk) ■1500TB (Disk)  XRootD based Data Handling (1 redirector + 10 storage nodes) Storage status for last 3 years TB used Gradual increase of disk usage after 310TB data transmission March 2016 → June 2013 > 99% Availability in reading and writing Disk Usage 88% 1,465 TB used May 2015 LHC RUN2 Data Acquisition Tape Disk

Status Report on KISTI’s Computing Activities7/18CKC Meeting, April 25, 2016 Storage (Tape) Tape 1.5PB Cache Pool 600TB XRootD(400TB)+GPFS(200TB) Tape Pool (XRootD) Service Servers GPFS/TSM Server (XRootD  Tape) ■1500TB (Tape)  1,465TB ALICE Raw Data Stored  ~800TB RUN2 Data Transferred  400 Tapes (4TB each)  8 Tape Drivers with 2GB/s Throughput Using Disk-based Cache to speed up the read/write from tape system Plan to add more tape media and increase the capacity to 2.5PB this year Almost Full!!

Status Report on KISTI’s Computing Activities8/18CKC Meeting, April 25, 2016 Site Availability/ Reliability  Monthly target is 97% in WLCG  Right on the track for stable and reliable service Keeping top most quality of services ReliabilityAvailability Overall in 2015Last 6 monthsOverall in 2015Last 6 months ALICE100 %99.8 %98 %99 % Sep.Oct.Nov.Dec.Jan. 2016Feb Reliability Availability ■Summary ■Monthly Availability/ Reliability (%) Participating in WLCG operation meeting once a week, reporting operation related issues Participating in WLCG operation meeting once a week, reporting operation related issues

KiAF, CMS

Status Report on KISTI’s Computing Activities10/18CKC Meeting, April 25, 2016 KiAF (KISTI Analysis Farm) ■Dedicated to Korean ALICE community  192 Cores with 176TB  HTCondor, XRootD, CVMFS afmaster01.sdfarm.kr (kiaf.sdfarm.kr) kwn1001.sdfarm.krkwn1008.sdfarm.kr 8 nodes SSH(Private Key) Submission Node Central Manager PROOF Master XRootD Header Execution Node PROOF Salve XRootD Server ROOT pod-submit … condor_submit … KiAF Tutorial  Annual evernt, available upon requests  Used for a communication channel for heavy users  Annual evernt, available upon requests  Used for a communication channel for heavy users

Status Report on KISTI’s Computing Activities11/18CKC Meeting, April 25, 2016 CMS Linked to all Tier-1s and some Tier-2s bidirectional way Monthly 42,000 jobs done Monthly 42,000 jobs done 183TB data stored Mostly used by top group Storage 400TB → 500TB Size Used Avail Use% Mounted on 3.0T 1.4T 1.7T 44% /cms/home 400T 346T 35T 86.5% /cms/data 10T 8.5T 1.6T 85% /cms/scratch 1.5T 496G 940G 35% /tmp_cms

Plans (Network & CMS Tier-2)

Status Report on KISTI’s Computing Activities13/18CKC Meeting, April 25, 2016 LHCOPN operation change (after September, 2016) Dedicated 10Gbps Protected 10Gbps G GLORIAD KISTI  CERN network will be fully managed by KISTI network team For stable and smooth service transition, service will be tested for at least one month. Commercial KISTI

Status Report on KISTI’s Computing Activities14/18CKC Meeting, April 25, 2016 Asia Tier Center Forum Registration Opening Site Reports TEIN ESNet Plan of 2016 Agreement between TEIN and GLORIAD for routing information exchange  2 nd ATCF in Thailand  Forum regulation  Secretariat Office at KISTI Steering wheel to solve common issues of Asia Tier centers 10 Tier Centers, ESnet, TEIN, KREONET, CERN

Status Report on KISTI’s Computing Activities15/18CKC Meeting, April 25, 2016 Inter-operation between GLORIAD-TEIN KISTI(KR) ↔ PAKGRID (PK) KISTI Daejeon Tokyo Singapore PAKGRID (PK) KREONET TRANSPAC PACIFICWAVE APAN-JP TEIN LA Seattle HK Before path (2015) After path (2016) Connection test (1Gbps) Tracepath test condition Source: KISTI-GSDC ( ) Destination: Pakgrid ( ) After ms Before ms Response time: ms  10 hops removed Response time: ms  10 hops removed These are initial test results. There should be many tuning points. These are initial test results. There should be many tuning points.

Status Report on KISTI’s Computing Activities16/18CKC Meeting, April 25, 2016 CMS Tier-2 Korea ■KNU(Kyungpook National University)’s CMS Tier-2 service will be no longer available after May  Decision made by recent CERN-Korea Cooperation Coordination Committee in Korea  Hard to keep sustainable service while data size is being gradually increased. ■KISTI will take over the service from KNU. KISTI’s service is not new service, but replacement of existing service although it is a new Tier-2 setup in Korea. ■It is too early to officially announce the plan, but KISTI will focus on smooth service transition,  Avoiding sudden service transition at a certain point (e.g. someday of May 2018)  Setting up a small scale service first and fully test the functionalities  Having service overlapping period with KNU Tier-2, e.g. two available Tier-2 services during a certain period of time, for example, 3 months  Giving users good enough time to recognize the service transition  Establishing a very tight communication channel with KCMS and CMS computing group ■Detailed plan will be shared in next CKC meeting (October, 2016).

Conclusions

Status Report on KISTI’s Computing Activities18/18CKC Meeting, April 25, 2016 Conclusions ■KISTI Tier 1 has been running stable and fully functional, providing very high quality of services for ALICE community. ■Sharing routing information between GLORIAD-TEIN, agreed in the 1 st Asia Tier Center Forum, is under going and initial result seems promising. ■2 nd Asia Tier Center Forum will be held in November, hosted by Suranaree University in Thailand. ■KISTI will take over KNU’s Tier-2 service (no longer available after May 2018). Detailed plan of KISTI’s CMS Tier-2 service, KNU’s Tier-2 replacement, will be shared in next CKC meeting. ■10Gbps network link between KISTI and CERN will be replaced with GLORIAD without service intervention in September, transitioning from a commercial link to the global research link. ■KISTI puts best efforts to support Korean researchers, KoALICE and KCMS, and such supporting will be getting strengthened.

Thank you