FJPPL @ CC-IN2P3 Lyon March 14, 2012 Yoshimi Iida @ KEK status of KEK iRODS FJPPL @ CC-IN2P3 Lyon March 14, 2012 Yoshimi Iida @ KEK

KEK iRODS 4 iRODS server stand for 4 iRODS Zone KEK-T2K KEK-MLF Only for the t2k nd280 group They use from October 2010 KEK-MLF Only for the mlf group Started discussion from December 2011 KEKZone For the other user at KEK The new user may use as a test demoKEKZone For the testbed 2

KEK iRODS 4 iRODS server stand for 4 iRODS Zone KEK-T2K KEK-MLF only for the t2k nd280 group started operation from October 2010 KEK-MLF only for the mlf group started discussion from December 2011 KEKZone for the other user at KEK each groups use here first demoKEKZone for the testbed 3

T2K nd280 Neutrino detectors located 280 m downstream of the target can measure the profile, purity, and energy distribution of the muon neutrinos A comparison of the measurements with those observed at the Super-Kamiokande will facilitate detailed studies of neutrino oscillation http://j-parc.jp/Neutrino/en/nu-facility.html

Overview of KEK-T2K cache area DB GPFS iRODS Client iRODS server disk HPSS T2K data server rodsweb temporary area archive area 5

Rule for KEK-T2K Bundle and replicate the data Trim the data Bundle files in a collection into a number of tar files to make it more efficient to store there files on HPSS A new tar file will be created whenever the number of subfiles exceeds 512 or the total size of the subfiles exceeds 4GBytes Create the tar files on GPFS then replicate it to HPSS Trim the data If the files is bundled or replicated, it's trimmed down from GPFS and local disk

Read-only usage Read-only account Read-only rodsweb create an irods account delete the home collection remove from public group don’t give a write permission for any collection Read-only rodsweb disable upload and modify the data Only allows access to users that have gone through the T2K website

The amount of data in KEK-T2K 22nd Dec, the beam operation resumed 11th Mar, the great east Japan earthquake 4th Jan, HPSS stop for the data migration

KEK iRODS 4 iRODS server stand for 4 iRODS Zone KEK-T2K KEK-MLF only for the t2k group started operation from October 2010 KEK-MLF only for the mlf group started discussion from December 2011 KEKZone for the other user at KEK each groups use here first demoKEKZone for the testbed 9

MLF MLF is Materials and Life Science Experimental Facility at J-PARC MLF is aimed at promoting materials science and life science using the world highest intensity pulsed neutron and muon beams which are produced using 3-GeV protons with a current of 333micro-amps and a repetition rate of 25 Hz They are using their own computing resource and storage resource at J-PARC now They prefer interactive job to batch job They are going to use the new KEKCC system Their storage system almost filled with the data scp from J-PARC to KEKCC is not fast enough

MLF file management tool Image of KEK-MLF DB MLF data storage server iRODS server iRODS Client HPSS MLF file management tool archive area We need more discussion with MLF group for an usage of iRODS 11

KEK iRODS 4 iRODS server stand for 4 iRODS Zone KEK-T2K KEK-MLF only for the t2k group started operation from October 2010 KEK-MLF only for the mlf group started discussion from December 2011 KEKZone for the other user at KEK each groups use here first demoKEKZone for the testbed 12

demoKEKZone Setup for the demonstration at iRODS workshop at KEK in September 2011 In order to explain how to use or what can do Created 15 guest account and gave a password for the participants Allow access from anywhere Only local disk use as iRODS resource

Setup the testbed It can be a low-threshold test environment where a user can quickly carry out some testing in a highly distributed environment Understanding how to use iRODS Testing some new tools they have developed or some research idea or some new hardware Federation with ccin2p3(France), QMUL(UK), UNC(U.S.), ASGC(Taiwan) and KEK(Japan)

iRODS Testbed Every site create a test user, and register them mutually Register the remote site

Using for demonstration Yutaka Kawai give the demo of Image Reconstruction at SC11 and ISGC2012 Fault-tolerant mechanism in dynamically changing environment We tried to replicate all file pieces in distributed file systems (testbed) Then, we can reconstruct the original file with the replicated pieces when some pieces cannot be accessed It would demonstrate replication and　recovery in a federated environment

System replacement

System replacement We replaced KEKCC containing iRODS system in February out of service for 1 week ~ 22 Feb, 2012 4 irods servers RHEL 5.4 iRODS 2.5 DB server PostgreSQL 8.3.5 Storage resource GPFS HPSS (HPSS-VFS) 29 Feb, 2012 ~ 4 irods servers RHEL 5.6 iRODS 2.5 DB server PostgreSQL 9.1.1 Storage resource GPFS HPSS (GHI)

System replacement We got a problem in GHI When the data is only in the HPSS, iRODS fail to read it Influence on iget, icp, irepl, etc.. iput to GHI area is OK If the data is in GPFS, it’s OK If the number of threads is less than 8, it’s OK We set the maximum number of threads to 8 in core.irb file temporarily acSetNumThreads||msiSetNumThreads(default,8,default)|nop

Web interface of log analyzer SCALA

SCALA -Statistical Charts And Log Analyzer- It’s developing by Wataru Takase who is a new face in KEK Web interface for iRODS administrator Statistical Charts display 4 graph of data volume, number of files, number of accesses and number of errors download a graph formatted PNG and CSV Log Analyzer display number of errors graph and error details helps to analyze iRODS log files easily

Statistical Charts Page 22

Statistical Charts Page The page has some Pull-down menus below Users menu Total shows all users’ information in total All users shows all users’ information User name shows the user’s information Resources menu All resources shows all resources’ information in total Resources name shows the resource’s information Data span menu X months shows last X months All days shows all days

Statistical Charts Page When you select pull-down menu, the graph is redrawn dynamically 2. Redraw graph 1. Select menu

Log Analyzer Page 25

2. Displayed error detail Log Analyzer Page When you click a bar, error log detail is displayed 1. Click a bar 2. Displayed error detail 26

Log Analyzer Page When you click an error, log file which contains the error displayed You can expand log file window by clicking the Expand button 1. Click an error 2. Open log file 27

SCALA SCALA’s web site http://tgwww.kek.jp/scala/

Plans

Plans Set up the KEK-MLF Upgrade iRODS to v3.0 in this summer The rule syntax is completely changed, but the new Rule Engine supports the old one It’s better to rewrite the rule Fix the GHI problem with iRODS parallel transfer Upgrade SCALA Data Volume graph only stack up the new data We are going to create a rule which detects the deleted data, and adapt it on the graph

thank you