Presentation is loading. Please wait.

Presentation is loading. Please wait.

Report PROOF session ALICE Offline FAIR Grid Workshop #1

Similar presentations


Presentation on theme: "Report PROOF session ALICE Offline FAIR Grid Workshop #1"— Presentation transcript:

1 Report PROOF session ALICE Offline FAIR Grid Workshop #1
Kilian Schwarz GSI

2 PROOF Session Title: CAF/GSIAF status/experience PROOF roadmap (Ganis)
New XrdProofd plugin Dynamic worker startup/removal Input data optimally distributed to nodes Memory monitor PROOF Lite (test setup before sending jobs to large cluster) Updated v (trunk instabilities in XrdProod plugin) Processing small number of large files with many workers (new packetiser strategy needed)

3 PROOF (2) Merging: Ongoing work: File backup on master
Workers send result when above certain size Ongoing work: Killing of memory eating sessions

4 PROOF related topics AliRoot raw-data reco in parallel via PROOF CAF:
New CAF Certificate based authentication Cmsd 8 Core machines, 2 TB staging space /WN 6.5 times faster than old CAF

5 PROOF related activities
GSIAF Merging (memory limit on master): being addressed PROOF cluster with submasters (should work in principle ) Authorised access to SEs from PROOF nodes should work when GSI authentication is used PROOF instability (xrd master infrastructure affected) should be solved with new ROOT Lack of PROOF documentation also mentioned by Latchezar

6 PROOF related activities
Virtual analysis facility (Bagnasco) 1 WNs runs via Xen 1 virtual LCG WN and 1 virtual PROOF slave More flexibility than only renice

7 FAIR Grid Workshop #1 New features in AliEn:
Physical deletion of files in SEs Working currently too fine  Tested intensively by Panda Implementation: SE optimiser looks for PFNs which have no corresponding LFNs anymore (e.g. after user deleted the entry in the FC) Files to be deleted are put to extra table Here SEs will look if there is something to delete for them If yes, SE will go to action

8 FAIR Grid workshop List only files in specific SE
setSElimit ALICE::GSI::SE Displays only files of selected SE Working for „ls“, to be implented in „find“ „get“ collections of multiple files and maintain directory structure of FC get –c (all files will be retrieved with their original lfn name) get –c –b <cut off part of directory tree>

9 FAIR Grid workshop Many new AliEn users
Panda, CBM, Romanian Air and Space, more projects in the Philippines New central Wiki has been setup as inter VO discussion forum for the setup of new central AliEn services ALICE profites a lot from new VOs debugging new AliEn features before they go into production for ALICE  AliEn developments also outside of ALICE

10 Xrd global redirector Tests with test clusters at GSI and Subatech:
Fetch files from CERN Delete/access files No transfer failures Performance: 80 MB/s at GSI 45 MB/s at Subatech Limit seems to be disk saturation


Download ppt "Report PROOF session ALICE Offline FAIR Grid Workshop #1"

Similar presentations


Ads by Google