Presentation is loading. Please wait.

Presentation is loading. Please wait.

DCAF(DeCentralized Analysis Farm) for CDF experiments HAN DaeHee*, KWON Kihwan, OH Youngdo, CHO Kihyeon, KONG Dae Jung, KIM Minsuk, KIM Jieun, MIAN shabeer,

Similar presentations


Presentation on theme: "DCAF(DeCentralized Analysis Farm) for CDF experiments HAN DaeHee*, KWON Kihwan, OH Youngdo, CHO Kihyeon, KONG Dae Jung, KIM Minsuk, KIM Jieun, MIAN shabeer,"— Presentation transcript:

1 DCAF(DeCentralized Analysis Farm) for CDF experiments HAN DaeHee*, KWON Kihwan, OH Youngdo, CHO Kihyeon, KONG Dae Jung, KIM Minsuk, KIM Jieun, MIAN shabeer, CHANG Sunghyeon, YANG Yuchul, KIM Donghee, SON Dongchul, CHO Ilsung1, LEE Jae Seung 1, YU Intae 1, LEE Jik 2, KIM Subong 2, LEE Jysoo 3 Center for High Energy Physics, Kyungpook National University. 1 Sungkyunkwan University. 2 Seoul National University. 3 KISTI. (On behalf of the HEP Data Grid Working Group in Korea)

2 Contents DCAF and SAM Grid Scheme of KorCAF and CAF A Design of DCAF in Korea for CDF (Fermilab) Grid System Structure of DCAF(1) System Structure of DCAF(2) FBSNG CAF GUI (Job Submission Tool) FBSWWW (Monitoring Tool) DCAF System Summary and Future Plan

3 DCAF and SAM Grid CAF (Central Analysis Farm) - Feynman Computer Center (FCC) at Fermilab for CDF Experiment - 306 Dual CPU clusters, 180TByte Disk Server - for CDF Experiment DCAF (DeCentralized Analysis Farm) - Limited resources and spaces at FCC - At Run IIb, data size is 7 times more than now  DCAF - Users around regional area and/or around the world SAM (Sequential data Access via Meta-data) - basically a distributed data transfer and management service - To handle real data at Fermilab for DCAF around world - Gridification of DCAF via SAM Grid Ref. http://www-cdf.fnal.gov/

4 Scheme of KorCAF and CAF DCAF in Korea(KorCAF) nkchep3.fnal.gov fcdfhead1.fnal.gov Cluster46.knu.ac.kr SAMGrid CAF

5 A Design of DCAF in Korea for CDF (Fermilab) Grid 1TB buffer (FCC) CAFGUI ICAFGUI SAM Station (KCAF) User Desktop Remote Desktop KCAF Head Node rcp, GridFTP bbftp cp KCAF Cluster FCC (CAF) CHEP (KCAF) ICAF FTP server CDFen (Raw Data) dCache rcp fcdfsam Smaster FSS, Stager stager Technical Request STKen Calibrati on Data dCache rcp

6 Head Node cluster46.knu.ac.kr Work Nodes cluster46.knu.ac.kr ~ Job submission Node nkchep3.fnal.gov System Structure of DCAF(1) CAF GUIDFBSWWW

7 System Structure of DCAF(2) SAM Grid

8 FBSNG Parallel Batch Jobs FBSNG job is a collection of sections. Each section is an array of identical, potentially co-operating, processes running on one or more farm nodes (worker nodes). Flexible Farm Configuration FBSNG allows unlimited number of resources of several types to be defined for the farm Dynamic Farm Configuration FBSNG Administrator can modify farm configuration using interactive configuration utility or GUI without re-starting FBSNG. Load Balancing FBSNG has fully customizable Scheduler FBSNG provides Application Programming Interface (API). Kerberos Support

9 CAF GUI (Job Submission Tool) Analysis farm CAF(Fermilab),korcaf(KNU) Process Type short,medium,long … Initial Command Original Directory Output File Location rcp/scp format that includes the Unix ID Email

10 FBSWWW (Monitoring Tool) Queues Jobs Nodes Process Types

11 DCAF System DCAF in KNU ObjectItemQuantity CPU AMD Athlon(tm) MP 2000+ 6 RAM2G3 HDD8G3 UPS40 KW1 Network Switch24x100Mbps + 2 x 1 Gbps 1 ※ Total KorCAF system will be 25 machines (33 CPUs)

12 Summary and Future Plan We have designed and succeeded in constructing KorCAF (DCAF in Korea). This is the first DCAF at CDF experiment that is outside of Fermilab. Currently we are making stability of the KorCAF (network, work nodes and storage) and setting for users for all CDF collaborators. Total KorCAF system will be 25 machines (33 CPUs) For the first step, to use the KorCAF as MC production farm. Plan for SC2003 Demo on KorCAF with KISTI.


Download ppt "DCAF(DeCentralized Analysis Farm) for CDF experiments HAN DaeHee*, KWON Kihwan, OH Youngdo, CHO Kihyeon, KONG Dae Jung, KIM Minsuk, KIM Jieun, MIAN shabeer,"

Similar presentations


Ads by Google