CHEP as an AMS Regional Center The Third International Workshop on HEP Data Grid CHEP, KNU G. N. Kim, J. W. Shin, N. Tasneem, M. W. Lee, D. Son H. Park (Center for High Energy Physics, KNU) (Supercomputing Center, KISTI)

Outline AMS Experiment Data flow from ISS to AMS Remote Center Data Size for AMS Experiment for 3 years AMS Science Operating Center Status of CHEP as an AMS Regional Center Status of MC Data Production bbFTP test Summary

AMS (Alpha Magnetic Spectrometer) Experiment PHYSICS GOALS : A Particle Physics Experiment on the International Space Station for 3 or 4 Years Will Collect ~10 10 Cosmic Rays in Near-Earth Orbit from 300 MeV to 3 TeV To search for Antimatter (He,C) in space with a sensitivity of 10 3 to 10 4 better than current limits. To search for Dark matter High statistics precision measurements of e ,  and p spectrum. To study Astrophysics. High statistics precision measurements of D, 3 He, 4 He, B, C, 9 Be, 10 Be spectrum  B/C: to understand CR propagation in the Galaxy (parameters of galactic wind).  10 Be/ 9 Be: to determine CR confinement time in the Galaxy.

International Collaboration International Collaboration ~200 scientists + dozens of contractors from 14 countries Spokesperson: TING, Samuel C. C.

AMS-02 (Alpha Magnetic Spectrometer)

White Sands, NM Data Flow from ISS to Remote AMS Centers Internet Distribute Locally & Conduct Science JSC 0.9 meter dish Commercial Satellite Service A Dedicated Service/Circuit Or MSFC POIC Telemetry Voice Planning Commanding Five Downlink Video Feeds & Telemetry Backup Remote User Facility Space Station

ACOP: AMS Crew Operations Post, POIC:Payload Operation Integration Center, GSC: Ground Support Computers

Table. AMS02 data transmitted to SOC from POIC Table. AMS02 Data Volumes Total AMS02 data volume is about 200 TB Stream Band Width Data Category Volume (TB/year) High Rate 3-4 Mbit/s Scientific 11 – 15 Calibration 0.01 Slow Rate 16 kbit/s Housing Keeping 0.06 NASA Auxillary Data 0.01 Origin Data Category Volume (TB) Beam Calibrations Calibration 0.3 Preflight Tests Calibration years flight Scientific 33 – 45 3 years flight Calibration years flight House Keeping 0.18 Data Summary Files (DST) Ntuples or ROOT files Catalogs Flat files or ROOT files or ORACLE 0.05 Event Tages Flat files or ROOT files or ORACLE 0.2 TDV files Flat files or ROOT files or ORACLE 0.5

AMS Science Operations Center (SOC) Data processing and Science Analysis receive the complete copy of data science analysis primary data storage data archiving data distribution to AMS Universities and Laboratories MC production The SOC will provide all functioning and will give the possibility to process and analyze all data. SOC computing facilities should be enough to provide data access and analysis for all members of the collaboration.

Science Operations Center Computing Facilities CERN/AMS Network AMS Physics Services N Central Data Services Shared Disk Servers 25 TeraByte disk 6 PC based servers 25 TeraByte disk 6 PC based servers tape robots tape drives LTO, DLT tape robots tape drives LTO, DLT Shared Tape Servers Home directories & registry consoles & monitors Production Facilities, Linux dual-CPU computers Linux, Intel and AMD Engineering Cluster 5 dual processor PCs 5 dual processor PCs Data Servers, Analysis Facilities (linux cluster) dual processor PCs 5 PC servers AMS regional Centers batch data processing batch data processing interactive physics analysis Interactive and Batch physics analysis

AMS Science Operation Center Computing Facilities

AMS Regional Center(s) Monte-Carlo Production Data Storage and data access for the remote stations AMS Regional Stations(s) and Center(s) Access to the SOC data storage * for the detector verification studies * for detector calibration purposes * for alignment * event visualization Access to the SOC to get the detector and production status Access to SOC computing facilities for Science Analysis Science Analysis using local computing facilities of Universities and Laboratories.

Connectivity from ISS to CHEP (RC) JSC MSFC POIC/ POCC Telemetry Voice Planning Commanding MIT LANs NINS B4207 vBNSMIT vBNS Chicago NAP CERN (SOC) CHEP ISP-1ISP-2 무궁화위성 ISP-3 RCRS Five Downlink Video Feeds & Telemetry Backup White Sands, NM ISP :Internet Service Provider NAP - Network Access Point vBNS - very high Broadband Network Service NINS - NASA Integrated Network Services POCC - Payload Operations Control Center POIC- Payload Operations Integration Center Commercial Satellite Service International Space Station (ISS)

Tape Library (~200 TB) Disk Storage (20TB) DB Server Gigabit Ethernet Linux Clusters Cluster Servers Hub Internet Server AMS RC CHEP as an AMS Regional Center Analysis Facility Data Storage Display Facility Ewha AMS RS 무궁화위성

AMS Analysis Facility at CHEP 1)CHEP AMS Cluster Server: 1 CPU: AMD Athlon MP dual Disk Space: 80 GB OS: Redhat 9.0 Linux Clusters : 12 CPU: AMD Athlon MP dual Disk Space: 80 GB x 12 =960 GB OS : Redhat 7.3 2) KT AMS Cluster Server: 1 CPU: Intel XEON 2GHz dual Disk Space: 80 GB OS: Redhat 9.0 Linux Clusters : 4 CPU: Intel XEON 2GHz dual Disk Space: 80 GB x 4 =320 GB OS:Redhat 7.3

 IBM TAPE LIBRARY SYSTEM – 43.7 TB  3494-L TB  3494-S TB  3494-L TB  3494-S TB  Raid Disks  Fast T200: 1 TB (Raid 0:striping) 43.7 TB L12 S10 Intermediate DISKPOOL TapeLibrary CDF, CMS, AMS, BELLE, PHENIX file system FastT200 RAID Disks Migration experimental group Login Machin e CCC CCC CCC CCC NFS cluster Data Storage

Network Configuration Servers L3 Switch C6509 KOREN … IBM 8271 PCs … Servers Gigabit Ethernet CERN GEANT-TEIN(EU) Fermilab KREONET Gigabit Ethernet APII/KREONET2 (US) KEK APII(Japan) 8Mbps 622Mbps x 2 1 Gbps x 2 Research Traffics KORNET Boranet other Traffics (total 145 Mbps) Gigabit Ethernet/ATM155 (Physics Department) Gigabit Switches (CHEP) 2.5 Gbps 34 Mbps

Connectivity to the Outside from CHEP APII JAPAN (KEK) APII USA (Chicago) TEIN (CERN) APII C hina (IHEP) USA StarTap, ESNET KOREN Topology CHEP (Regional Center) Daegu 2.5 Gbps Seoul Daejeon Daegu ■ Singapore (1) SIngAREN through APII (2Mbps) ■ China (1, Preplanned) CSTNET (APII) thru APII

Europe CERN TEIN APII-TransPac Hyunhai/Genkai US FNAL Connectivity to the Outside from Korea StarTap

MC Production Center and their Capacity

Step:2 Click here! Step:1 Write here registered info. Step:3 Choose any one from datasets. Step:4 Choose appropriate dataset. MC Production Procedure by Remote Client

Step:5 Choose appropriate CPU Type & CPU clock. Step:6 Put appropriate CPU time limit. Step:7 Put total number of jobs requested Step:8 Put ‘Total Real Time Required’. Step:9 Choose MC production Mode. Step:10 Click On ‘Submit Request’ MC Production Procedure by Remote Client

MC Database Query Form

MC Data Production Status MC Center ResponsibleGB%CIEMATJ.Casuas CERN V.Choutko, A.Eline,A.Klimentov YaleE.Finch Academia Sinica Z.Ren, Y.Lei LAPP/Lyon C.Goy, J.Jacquemier INFN Milano M.Boschini, D.Grandi CNAF & INFN Bologna D.Casadei UMDA.Malinine EKP, Karlsruhe V.Zhukov GAM, Montpellier J.Bolmont, M.Sapinski INFN Siena&Perugia, ITEP, LIP, IAC, SEU, KNU P.Zuccon, P.Maestro, Y.Lyublev, F.Barao, C.Delgado, Ye Wei, J.Shin

MC Production Statistics Particle Million Events % of Total protons helium electrons positrons deuterons anti- protons carbon photons Nuclei (Z 3 … 28) URL: pcamss0.cern.ch/mm.html 185 days, 1196 computers 8.4 TB, 250 PIII 1 GHz/day

Total Number of Requested Job : 229 Completed Job : 218 Failed Job : 1 Unchecked Job (may be error) : 10 MC Events Production at CHEP ParticleRequestedCompletedFailed DST size[GB] Positron Electron Proton Nuclear C He Total

Data Handling Program: bbFTP bbFTP is a file transfer software developed by Gilles Farrache in Lyon Encoded username and password at connection SSH and Certificate authentification modules Multi-stream transfer Big windows as defined in RFC1323 On-the-fly data compression Automatic retry Customizable time-outs Transfer simulation AFS authentification integration RFIO interface

Data Transmission Test using bbFTP Using TEIN in Dec for a number of TCP/IP streams - for a file size

Using APII/KREONET2-Startap in Aug for a number of TCP/IP streams - for a file size

CHEP as AMS Regional Center -Prepared an Analysis Facility and Data Storage -Producing MC events -Progress in MC production with GRID Tools Summary