Presentation is loading. Please wait.

Presentation is loading. Please wait.

DCAF (DeCentralized Analysis Farm) Korea CHEP Fermilab (CDF) KorCAF (DCAF in Korea) Kihyeon Cho (CHEP, KNU) (On the behalf of HEP Data Grid Working Group)

Similar presentations


Presentation on theme: "DCAF (DeCentralized Analysis Farm) Korea CHEP Fermilab (CDF) KorCAF (DCAF in Korea) Kihyeon Cho (CHEP, KNU) (On the behalf of HEP Data Grid Working Group)"— Presentation transcript:

1 DCAF (DeCentralized Analysis Farm) Korea CHEP Fermilab (CDF) KorCAF (DCAF in Korea) Kihyeon Cho (CHEP, KNU) (On the behalf of HEP Data Grid Working Group)

2 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS Production Farm Ref. Mark Neubauer

3 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS Stage 1 & 2 Feynman Computer Center (FCC) at Fermilab for CDF Experiment 306 Dual CPUs and 180TByte FCC (Feynman Computer Center) CAF (Central Analysis Farm)

4 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS CAF design considered:  Submit jobs from 'anywhere‘  Job output can be sent directly to desktop or stored on CAF for later retrieval Integer CAF Design Ref. Mark Neubauer

5 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS Requirement set by goal  200 simultaneous users should analyze 10 7 events in a day  Need ~700 TB of disk and ~5THz of CPU by end of FY’05  DCAF (DeCentralized Analysis Farm) SAM (Sequential Access through Meta data)  To handle real data at Fermilab for DCAF around world  Gridification of DCAF via SAM Grid KorCAF (DeCenteralized Analysis Farm in Korea) Why DCAF and SAM for CDF?

6 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS DCAF in Korea (KorCAF) CAF or Proposed Schemes for SAMGrid

7 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS 1TB buffer (FCC) CAFGUI ICAFGUI SAM Station (KCAF) User Desktop Remote Desktop KCAF Head Node rcp, GridFTP bbftp cp KCAF Cluster FCC (CAF) CHEP (KCAF) ICAF FTP server CDFen (Raw Data) dCache rcp fcdfsam Smaster FSS, Stager stager Technical Request STKen Calibration Data dCache rcp A Design of KorCAF for CDF (Fermilab) Grid

8 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS Schedule for DCAF & SAMGrid Schedule for DCAF & SAMGrid Nov. 2002 – Installed JIM v0.0 and demo on SC2002 July-August 2003 – Installing DCAF v1.0 Oct. 2003 – To install JIM (Job Information Management) v1.0 environment based on DCAF Nov. 2003 – demo on SC2003 by users

9 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS Methods for SAMGrid for CDF CAF(Central Analysis Farm) current Installing PBS batch (each institutes) CDF SAMGrid DCAF (DeCentralized Analysis Farm) SAM (for real data) Current

10 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS Testbed at CHEP

11 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS CDF Grid Testbed at CHEP DCAF: C73, C46~C49 (5 machines, 10 CPUs) PBS Batch: (20 machines, 23 CPUs)  Total Grid Test bed: 25 machines (33 CPUs)

12 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS Network Test (Parallel ftp’s are used)  ~60 Mbps (155 Mbps/1Gbps) via Hyeonhae/Genkai  ~30 Mbps ( 155 Mbps) via Star-tap Daejeon APII TEIN … CHEP Seoul Daegu Busan US Fermilab 2 x 155Mbps 1Gbps 155Mbps 40Gbps Hyeonhae/I Genkai … 2 X 1Gbps 155Mbps Network between CHEP and Fermilab

13 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS SAM Grid Fermi Lab Installation of DCAF & SAMGrid Installation of DCAF & SAMGrid

14 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS SAMGrid Monitoring Page

15 KIHYEON CHO CENTER FOR HIGH ENERGY PHYSICS SAMGrid demo was showed at SC2002.  6 institutes (KNU, Toronto, RAL, Rutgers, Texas Tech, Glasgow) were involved for CDF experiment.  At KNU, 12 CPUs were allocated for SAM Grid Demo UCSD made testbed for DCAF. KorCAF(DCAF in Korea) is the first for analysis farm at CDF experiment as DCAF For the first step, to use the KorCAF as MC production farm. Later, real data… Prepare for SC2003 Demo for SAMGrid DCAF Activities


Download ppt "DCAF (DeCentralized Analysis Farm) Korea CHEP Fermilab (CDF) KorCAF (DCAF in Korea) Kihyeon Cho (CHEP, KNU) (On the behalf of HEP Data Grid Working Group)"

Similar presentations


Ads by Google