1. FJPPL @ CC-IN2P3 Lyon March 14, 2012 Yoshimi Iida @ KEK
status of KEK iRODS
CC-IN2P3 Lyon
March 14, 2012
Yoshimi KEK

2. KEK iRODS 4 iRODS server stand for 4 iRODS Zone KEK-T2K KEK-MLF
Only for the t2k nd280 group
They use from October 2010
KEK-MLF
Only for the mlf group
Started discussion from December 2011
KEKZone
For the other user at KEK
The new user may use as a test
demoKEKZone
For the testbed 2

3. KEK iRODS 4 iRODS server stand for 4 iRODS Zone KEK-T2K KEK-MLF
only for the t2k nd280 group
started operation from October 2010
KEK-MLF
only for the mlf group
started discussion from December 2011
KEKZone
for the other user at KEK
each groups use here first
demoKEKZone
for the testbed 3

4. T2K nd280
Neutrino detectors located 280 m downstream of the target can measure the profile, purity, and energy distribution of the muon neutrinos
A comparison of the measurements with those observed at the Super-Kamiokande will facilitate detailed studies of neutrino oscillation

5. Overview of KEK-T2K cache area DB GPFS iRODS Client iRODS server disk
HPSS
T2K
data server
rodsweb
temporary
area
archive area 5

6. Rule for KEK-T2K Bundle and replicate the data Trim the data
Bundle files in a collection into a number of tar files to make it more efficient to store there files on HPSS
A new tar file will be created whenever the number of subfiles exceeds 512 or the total size of the subfiles exceeds 4GBytes
Create the tar files on GPFS then replicate it to HPSS
Trim the data
If the files is bundled or replicated, it's trimmed down from GPFS and local disk

7. Read-only usage Read-only account Read-only rodsweb
create an irods account
delete the home collection
remove from public group
don’t give a write permission for any collection
Read-only rodsweb
disable upload and modify the data
Only allows access to users that have gone through the T2K website

8. The amount of data in KEK-T2K
22nd Dec, the beam operation resumed
11th Mar, the great
east Japan earthquake
4th Jan, HPSS stop for the data migration

9. KEK iRODS 4 iRODS server stand for 4 iRODS Zone KEK-T2K KEK-MLF
only for the t2k group
started operation from October 2010
KEK-MLF
only for the mlf group
started discussion from December 2011
KEKZone
for the other user at KEK
each groups use here first
demoKEKZone
for the testbed 9

10. MLF MLF is Materials and Life Science Experimental Facility at J-PARC
MLF is aimed at promoting materials science and life science using the world highest intensity pulsed neutron and muon beams which are produced using 3-GeV protons with a current of 333micro-amps and a repetition rate of 25 Hz
They are using their own computing resource and storage resource at J-PARC now
They prefer interactive job to batch job
They are going to use the new KEKCC system
Their storage system almost filled with the data
scp from J-PARC to KEKCC is not fast enough

11. MLF file management tool
Image of KEK-MLF DB
MLF
data storage server
iRODS
server
iRODS
Client
HPSS
MLF file management tool
archive area
We need more discussion with MLF group
for an usage of iRODS 11

12. KEK iRODS 4 iRODS server stand for 4 iRODS Zone KEK-T2K KEK-MLF
only for the t2k group
started operation from October 2010
KEK-MLF
only for the mlf group
started discussion from December 2011
KEKZone
for the other user at KEK
each groups use here first
demoKEKZone
for the testbed 12

13. demoKEKZone
Setup for the demonstration at iRODS workshop at KEK in September 2011
In order to explain how to use or what can do
Created 15 guest
account and gave
a password for
the participants
Allow access from
anywhere
Only local disk use
as iRODS resource

14. Setup the testbed
It can be a low-threshold test environment where a user can quickly carry out some testing in a highly distributed environment
Understanding how to use iRODS
Testing some new tools they have developed or some research idea or some new hardware
Federation with
ccin2p3(France), QMUL(UK), UNC(U.S.), ASGC(Taiwan) and KEK(Japan)

15. iRODS Testbed Every site create a test user,
and register them mutually
Register the remote site

16. Using for demonstration
Yutaka Kawai give the demo of Image Reconstruction at SC11 and ISGC2012
Fault-tolerant mechanism in dynamically changing environment
We tried to replicate all file pieces in distributed file systems (testbed)
Then, we can reconstruct the original file with the replicated pieces when some pieces cannot be accessed
It would demonstrate replication and　recovery in a federated environment

17. System replacement

18. System replacement
We replaced KEKCC containing iRODS system in February
out of service for 1 week
~ 22 Feb, 2012
4 irods servers
RHEL 5.4
iRODS 2.5
DB server
PostgreSQL 8.3.5
Storage resource
GPFS
HPSS (HPSS-VFS)
29 Feb, 2012 ~
4 irods servers
RHEL 5.6
iRODS 2.5
DB server
PostgreSQL 9.1.1
Storage resource
GPFS
HPSS (GHI)

19. System replacement We got a problem in GHI
When the data is only in the HPSS, iRODS fail to read it
Influence on iget, icp, irepl, etc..
iput to GHI area is OK
If the data is in GPFS, it’s OK
If the number of threads is less than 8, it’s OK
We set the maximum number of threads to 8 in core.irb file temporarily
acSetNumThreads||msiSetNumThreads(default,8,default)|nop

20. Web interface of log analyzer
SCALA

21. SCALA -Statistical Charts And Log Analyzer-
It’s developing by Wataru Takase who is a new face in KEK
Web interface for iRODS administrator
Statistical Charts
display 4 graph of data volume, number of files, number of accesses and number of errors
download a graph formatted PNG and CSV
Log Analyzer
display number of errors graph and error details
helps to analyze iRODS log files easily

22. Statistical Charts Page22

23. Statistical Charts Page
The page has some Pull-down menus below
Users menu
Total
shows all users’ information in total
All users
shows all users’ information
User name
shows the user’s information
Resources menu
All resources
shows all resources’ information in total
Resources name
shows the resource’s information
Data span menu
X months
shows last X months
All days
shows all days

24. Statistical Charts Page
When you select pull-down menu, the graph is redrawn dynamically
2. Redraw graph
1. Select menu

25. Log Analyzer Page 25

26. 2. Displayed error detail
Log Analyzer Page
When you click a bar, error log detail is displayed
1. Click a bar
2. Displayed error detail 26

27. Log Analyzer Page
When you click an error, log file which contains the error displayed
You can expand log file window by clicking the Expand button
1. Click an error
2. Open log file 27

28. SCALA
SCALA’s web site

29. Plans

30. Plans Set up the KEK-MLF Upgrade iRODS to v3.0 in this summer
The rule syntax is completely changed, but the new Rule Engine supports the old one
It’s better to rewrite the rule
Fix the GHI problem with iRODS parallel transfer
Upgrade SCALA
Data Volume graph only stack up the new data
We are going to create a rule which detects the deleted data, and adapt it on the graph

31. thank you