CDF Grid at KISTI 정민호, 조기현 *, 김현우, 김동희 1, 양유철 1, 서준석 1, 공대정 1, 김지은 1, 장성현 1, 칸 아딜 1, 김수봉 2, 이재승 2, 이영장 2, 문창성 2, 정지은 2, 유인태 3, 임 규빈 3, 주경광 4, 김현수 5, 오영도.

Slides:

Advertisements

Similar presentations

Kejun Dong, Kai Nan CNIC/CAS CNIC Resources And Activities Update Resources Working Group PRAGMA11 Workshop, Oct.16/17 Osaka, Japan.

Advertisements

GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.

Physics with SAM-Grid Stefan Stonjek University of Oxford 6 th GridPP Meeting 30 th January 2003 Coseners House.

EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,

Heavy Flavor Physics as e-Science

고에너지물리를 위한 협업환경 도구와 KISTI EVO 서버 김현우, 조기현 * 한국과학기술정보연구원 (KISTI) * 교신저자 2007 년 11 월 일 KOSTI2007/ 한국콘텐츠학회, 대전 배재대.

DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.

Sep Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova.

22/04/2005Donatella Lucchesi1 CDFII Computing Status OUTLINE:  New CDF-Italy computing group organization  Usage status at FNAL and CNAF  Towards GRID:

Site Report US CMS T2 Workshop Samir Cury on behalf of T2_BR_UERJ Team.

Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug

SCD FIFE Workshop - GlideinWMS Overview GlideinWMS Overview FIFE Workshop (June 04, 2013) - Parag Mhashilkar Why GlideinWMS? GlideinWMS Architecture Summary.

OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.

YuChul Yang kr October 21, 2005The Korean Physical Society The Current Status of CDF Grid 양유철 *, 한대희, 공대정, 김지은, 서준석, 장성현, 조기현, 오영도,

LcgCAF:CDF submission portal to LCG Federica Fanzago for CDF-Italian Computing Group Gabriele Compostella, Francesco Delli Paoli, Donatella Lucchesi, Daniel.

Two e-Science Components for HEP: EVO and Remote Control Room Hyunwoo KIM, Minho Jeung Kihyeon CHO* Sep , Daejeon (* Corresponding Author)

YuChul Yang Oct KPS 2006 가을 EXCO, 대구 The Current Status of KorCAF and CDF Grid 양유철, 장성현, 미안 사비르 아메드, 칸 아딜, 모하메드 아즈말, 공대정, 김지은,

Building a distributed software environment for CDF within the ESLEA framework V. Bartsch, M. Lancaster University College London.

3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.

CHEP 2003Stefan Stonjek1 Physics with SAM-Grid Stefan Stonjek University of Oxford CHEP th March 2003 San Diego.

Installation Sites. Active SAM-Grid Sites  The following sites are actively used for different types of jobs Monte Carlo – production of simulated events.

1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.

A Design for KCAF for CDF Experiment Kihyeon Cho (CHEP, Kyungpook National University) and Jysoo Lee (KISTI, Supercomputing Center) The International Workshop.

Interactive Job Monitor: CafMon kill CafMon tail CafMon dir CafMon log CafMon top CafMon ps LcgCAF: CDF submission portal to LCG resources Francesco Delli.

SAMGrid as a Stakeholder of FermiGrid Valeria Bartsch Computing Division Fermilab.

YongPyong 2012 Winter Conference on Particle Physics February 20~23,

Use of Condor on the Open Science Grid Chris Green, OSG User Group / FNAL Condor Week, April

A Plan for HEP Data Grid Project in Korea Kihyeon Cho Center for High Energy Physics (CHEP) Kyungpook National University CDF/D0 Grid Meeting August 5,

International Workshop on HEP Data Grid Nov 9, 2002, KNU Data Storage, Network, Handling, and Clustering in CDF Korea group Intae Yu*, Junghyun Kim, Ilsung.

22 nd September 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.

São Paulo Regional Analysis Center SPRACE Status Report 22/Aug/2006 SPRACE Status Report 22/Aug/2006.

LIA-FKPPL Workshop, CCIN2P3 in Lyon, France February 26, KIhyeon Cho (KISTI) and Aurore Savoy-Navarro (LPNHE) CDF in FKPPL.

Two Types of Remote CDF Shifts (Remote Control Room) for CDF Experiment 김현우 CDF Korea Workshop, Daejeon APRIL

Remote Control Room and SAM DH Shifts at KISTI for CDF Experiment 김현우, 조기현, 정민호 (KISTI), 김동희, 양유철, 서준석, 공대정, 김지은, 장성현, 칸 아딜 ( 경북대 ), 김수봉, 이재승, 이영장, 문창성,

A Test Framework for Movement of MC Data using SAM & SRM Interface Manoj K. Jha (INFN- Bologna) Antonio Cuomo, Donatella Lucchesi, Gabriele Compostella,

INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)

Evolution of a High Performance Computing and Monitoring system onto the GRID for High Energy Experiments T.L. Hsieh, S. Hou, P.K. Teng Academia Sinica,

US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.

Condor Week 2004 The use of Condor at the CDF Analysis Farm Presented by Sfiligoi Igor on behalf of the CAF group.

AliEn AliEn at OSC The ALICE distributed computing environment by Bjørn S. Nilsen The Ohio State University.

INFSO-RI Enabling Grids for E-sciencE GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN.

May Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova.

Outline: Status: Report after one month of Plans for the future (Preparing Summer -Fall 2003) (CNAF): Update A. Sidoti, INFN Pisa and.

DCAF (DeCentralized Analysis Farm) Korea CHEP Fermilab (CDF) KorCAF (DCAF in Korea) Kihyeon Cho (CHEP, KNU) (On the behalf of HEP Data Grid Working Group)

DCAF(DeCentralized Analysis Farm) for CDF experiments HAN DaeHee*, KWON Kihwan, OH Youngdo, CHO Kihyeon, KONG Dae Jung, KIM Minsuk, KIM Jieun, MIAN shabeer,

International Workshop on HEP Data Grid Aug 23, 2003, KNU Status of Data Storage, Network, Clustering in SKKU CDF group Intae Yu*, Joong Seok Chae Department.

Auditing Project Architecture VERY HIGH LEVEL Tanya Levshina.

Eileen Berman. Condor in the Fermilab Grid FacilitiesApril 30, 2008  Fermi National Accelerator Laboratory is a high energy physics laboratory outside.

March 1, CDF Grid Daejung Kong and Kihyeon Cho* (High Energy Physics Team, KISTI) * Corresponding author June 25, 2009 Korea CDF Meeting, SNU, Korea.

VOX Project Status T. Levshina. 5/7/2003LCG SEC meetings2 Goals, team and collaborators Purpose: To facilitate the remote participation of US based physicists.

Integration of Physics Computing on GRID S. Hou, T.L. Hsieh, P.K. Teng Academia Sinica 04 March,

Geant4 International Workshop June 13, Kihyeon Cho Contents Introduction  High Energy Physics at KISTI Geant4 Project Simulation on secondary.

Campus Grid Technology Derek Weitzel University of Nebraska – Lincoln Holland Computing Center (HCC) Home of the 2012 OSG AHM!

Collider Physics based on e-Science Paradigm Kihyeon Cho (On behalf of High Energy Physics KISTI) APCTP YongPyong 2010 YongPyong Resort, Korea,

2 CMS 6 PB raw/run Phobos 50 TB/run E917 5 TB/run.

거대계산과학 허브 워크샵 ~13 부산대

CDF Monte Carlo Production on LCG GRID via LcgCAF Authors: Gabriele Compostella Donatella Lucchesi Simone Pagan Griso Igor SFiligoi 3 rd IEEE International.

UCS D OSG Summer School 2011 Overlay systems OSG Summer School An introduction to Overlay systems Also known as Pilot systems by Igor Sfiligoi University.

European Condor Week CDF experience with Condor glide-ins and GCB - Igor Sfiligoi1 European Condor Week 2006 Using Condor Glide-Ins and GCB to run.

Condor Week 2006, University of Wisconsin 1 Matthew Norman Using Condor Glide-ins and GCB to run in a grid environment Elliot Lipeles, Matthew Norman,

IFAE Apr CDF Computing Experience - Gabriele Compostella1 IFAE Apr CDF Computing Experience Gabriele Compostella, University.

LcgCAF:CDF submission portal to LCG

Short update on the latest gLite status

Kihyeon Cho Supercomputing Center KISTI

Particle Physics at KISTI

LHC Data Analysis using a worldwide computing grid

e-Science for High Energy Physics

Data Processing for CDF Computing

Collider Physics based on e-Science Paradigm

Kihyeon Cho* (High Energy Physics Team, KISTI)

Presentation transcript:

CDF Grid at KISTI 정민호, 조기현 *, 김현우, 김동희 1, 양유철 1, 서준석 1, 공대정 1, 김지은 1, 장성현 1, 칸 아딜 1, 김수봉 2, 이재승 2, 이영장 2, 문창성 2, 정지은 2, 유인태 3, 임 규빈 3, 주경광 4, 김현수 5, 오영도 6, 전은주 7 KISTI 응용연구개발팀. 1 경북대 물리 및 에너지학부. 2 서울대 물리학부. 3 성균관대 물리학과. 4 전남대 물리학과. 5 전북대 물리학과. 6 포항공대 물리학과. 7 세종대 물리학과. October 24, 2008 KISTI * Corresponding author 한국물리학회 ~24 광주 김대중 컨벤션 센터

Contents  e-Science for High-Energy Physics  CDF Farms around world  Progress of CDF Farms  Grid CAF  The Comparison of Grid CAF  Pacific CAF at KISTI  Monitoring of Pacific CAF  The Reason of exploiting GRID on CDF  CDF Grid Computing Center (CGCC)  Summary

3 Three components of e-HEP 1. e-Science for High-Energy Physics Data production Data publication Data processing EVO EVO (Enabling Virtual Organization) CDF Farm Remote Control Room

4 2. CDF Farms around world European CAF Pacific CAF North American CAF Tsukuba U ASGC, Taiwan KISTI KNU CAF(2001)DCAF(2003) Grid CAF (2006)CGCC(2008) UCSD CAF Toronto CAF Rut CAF Lyon CAF Taiwan AS BCN CAF CNAF CAF Korean CAF : KISTI, KNU Japan CAF

5 3. Progress of CDF Farms Name Starting Date Gridmiddleware Job scheduling ContentSite CAF2001-Condor Cluster farm inside Fermilab USA (Fermilab) DCAF2003-Condor Cluster farm outside Fermilab Korea, Japan, Taiwan, Spain (Varcelona, Cantabria), USA (Rutgers, San Diego), Canada, France Grid CAF 2006LCG/OSG Resource Broker, Condor Grid farm North America CAF European CAF Pacific CAF CGCC (CDF Grid Computing Center) 2008LCG Resource Broker, Condor Big Grid farm Korea (KISTI) France (IN2p3) Italy (CNAF)

6 4. Grid CAF Context Diagram of Grid CAF CAF GUI Grid Farm (European CAF) Grid Farm (North America CAF) Grid Farm (Pacific CAF) Grid Site (IPAS_CS) Grid Site (IPAS_OSG) Grid Site (Taiwan-LCG2 ) Grid Site (JP-TSUKUBA) Grid Site (KR-KISTI-HEP) Legend Service ComponentGrid CAF BoundaryGrid Site Boundary Job TransportGrid Pool User Interface

7 5. The comparison of Grid CAF Grid CAF Head node Work node GridMiddlewareMethodVO (Virtual Organization) North America CAF Fermilab (USA) USSD(USA)etcOSG Condor over Globus CDF VO European CAF CNAF (Italia) IN2P3(France)EtcLCGWMS (Workload Management System) CDF VO Pacific CAF AS (Taiwan) KISTI(Korea)etc LCG, OSG Condor over Globus CDF VO

8 6. Pacific CAF at KISTI (1) Service Component Legend Repository Grid CAF BoundaryGrid Site BoundaryGrid Pool Job Data Transportation Control Data Transportation Grid Site (KR-KISTI-HEP) Worker Node (hep015) ……………… (hep004) Work Node (hep003) dCache Pool (se-hep) Grid Farm (Pacific CAF) VOMS Authentication Glideins dCache User Interface CafGui CafSubmit CafMon CAF Head Node Submitter Monitor Collector Negotiator Schedd Globus.... Job Submission Web monitoring Job Output Condor CE (hep001)....

9 6. Pacific CAF at KISTI (2) Current hardware allocation status of KR-KISTI-HEP  Head node  paccaf.phys.sinica.edu.tw at Academia Sinica (Taiwan)  VOMS server  voms.cnaf.infn.it at CNAF (Italy)  Work nodes  25 core processes  Storage at KISTI  30 T byte

10 7. Monitoring of Pacific CAF (1)

11 7. Monitoring of Pacific CAF (2)

12 8. The reason of exploiting GRID on CDF Donatella Lucchesi (December 11, 2007) e-Science 07

13 9. CDF Grid Computing Center (CGCC) Pacific CAF at KISTICGCC at KISTI Head node paccaf.phys.sinica.edu.twNew Head node VOMS server voms.cnaf.infn.itNew VOMS server Work nodes 25 core processes400 core processes Storage 30 T byte300 T byte A hardware allocation plan for CGCC

Summary High-energy physics is a good application of e-Science. The e-Science for high-energy physics has three components: data production, data processing and data analysis The system for data processing for CDF experiments is embedded at KISTI. CGCC (CDF Grid Computing Center) is being built at KISTI.

15 References Kihyeon Cho (KISTI), e-Science for High-Energy Physics in Korea, JKPS, Vol. 53, N0. 2, August 2008, pp. 1187~1191 Igor Sfiligoi, CDF computing, Computer Physics Communications 177 (2007) 235~238 Gabriele Compostella, Donatella Lucchesi, Simone Pagan Griso, Igor Sfiligoi, CDF Monte Carlo Production on LCG GRID via LcgCAF, 3 rd IEEE International Conference on e-Science and Grid Computing, December 10~13, 2007 Kihyeon Cho (KISTI), CDF 그리드 현재 및 발전방향, KISTI HEP Seminar, January 30, 2008 Kihyeon Cho (KISTI), CDF Grid - DCAF (Decentralized CDF Analysis Farm), KISTI HEP Seminar, March 8, 2007