Presentation is loading. Please wait.

Presentation is loading. Please wait.

Silvio Pardi spardi@na.infn.it R&D Storage Silvio Pardi spardi@na.infn.it.

Similar presentations


Presentation on theme: "Silvio Pardi spardi@na.infn.it R&D Storage Silvio Pardi spardi@na.infn.it."— Presentation transcript:

1 Silvio Pardi spardi@na.infn.it
R&D Storage Silvio Pardi

2 EXPERIENCES

3 EXPERIENCES

4 RECOMMENDATION

5 RACCOMANDATION Daniele Bonaccorsi Gerd Behrmann LUCA DELL’AGNELLO

6 FUTURE WORKS AND POSSIBILE SINERGY

7

8 Alex Martin

9 Storage R&D Action Item

10 Incoming people are welcome!
People Involved Domenico Del Prete – INFN-Naples Diacono Domenico – INFN-Bari Donvito Giacinto – INFN-Bari Armando Fella – INFN-Pisa Silvio Pardi – INFN-Naples Spinoso Vincenzo – INFN-Bari Guido Russo – INFN-Naples Alex Martin – Queen Mary Brian Bockelman In testing HDSF? EMI People? Other People? Incoming people are welcome!

11 Action and Activity Writing the Storage R&D program for the general document “The SuperB Computing R&D program” My Duty - the document is at 50% I plan to complete with the outcome of this meeting.

12 Activity on-going “Local” Storage system test:
Going on testing users code against interesting storage solutions: Lustre, Hadoop, Xrootd, GlusterFS… This will be interesting not only from a Site Admin point of view but also, for the end-user in order to “monitor” the performance of the experiment code (see Brian Talk – slide 26) Test on “WN co-located storage solutions” vs “Server Based solutions” This will be tested also to understand the implication of a geographically-distributed hadoop-like storage A Dedicate cluster in INFN-Naples for this activities All these activities is going on and will go on for a long time in the future People already working from INFN-Bari and INFN-Naples Results will go into CTDR

13 Activity on-going “Grid” Data Management:
Going on testing DIRAC to exploit DMS features Start submitting (with DIRAC) few simple SuperB Grid jobs using DIRAC DMS features in order to retrieve and store data Testing the dataset replication using DIRAC DMS features Testing the metadata handling DIRAC features trying to gather requirements from Physics people (starting with FastSim?) This activities is already started in INFN-Bari It is related to an activity in Distributed Computing that are evaluating DIRAC as job submission tool First results in 6-7 months from now The results of both (Distributed Computing and Distributed Storage) activities will go in CTDR

14 Activity on-going – 2 “Grid” Software Distribution:
How distributed the software over the sites using automatic file distribution system. Test Based on the CVMFS showed by Alessandro de Salvo in the previous session. This activities is already started in INFN-Naples for the ALTAS collaboration Understand if this solution is applicable also for other use-case The results of both (Distributed Computing and Distributed Storage) activities will go in CTDR

15 Future Activity “Job Locality”: “Distributed Sites” NFSv4.1:
Trying to understand if we can use a paradigm in which the job run as closer as possible to the data (See “Bricks” in Lustre or “Racks” in hadoop or similar in Gluster) “Distributed Sites” Testing how we can set-up a distributed Tier1 in italy: Which file-system works better in this environment (i.e. Hadoop, GlusterFS, dCache)? How to replicate services? How to distribute the jobs? When we will have 10Gbps network with GARRX? These activities will start at INFN-BARI and INFN-Naples in September NFSv4.1: Testing if pNFS could be of interest for the SuperB community in the next year Section Interested INFN-Bari, INFN-Pisa and INFN-Naples but no solution is usable at the moment => we need to follow the issue Remote data access: Testing is SuperB code is already usable in high latency network and provide feedback to the developers - This activity will start in Bari in October

16 Thank you


Download ppt "Silvio Pardi spardi@na.infn.it R&D Storage Silvio Pardi spardi@na.infn.it."

Similar presentations


Ads by Google