CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, 13-14 November 2008.

Slides:



Advertisements
Similar presentations
Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS CASTOR Status Alberto Pace.
Advertisements

Steve Traylen Particle Physics Department Experiences of DCache at RAL UK HEP Sysman, 11/11/04 Steve Traylen
Owen SyngeDCache Slide 1 D-Cache Status Report Owen Synge.
Wahid Bhimji SRM; FTS3; xrootd; DPM collaborations; cluster filesystems.
Storage: Futures Flavia Donno CERN/IT WLCG Grid Deployment Board, CERN 8 October 2008.
Storage Issues: the experiments’ perspective Flavia Donno CERN/IT WLCG Grid Deployment Board, CERN 9 September 2008.
Project Overview GridPP Storage J Jensen GridPP storage workshop RHUL, April 2010.
CASTOR Upgrade, Testing and Issues Shaun de Witt GRIDPP August 2010.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
INFSO-RI Enabling Grids for E-sciencE SRMv2.2 experience Sophie Lemaitre WLCG Workshop.
CERN - IT Department CH-1211 Genève 23 Switzerland t LCG Deployment GridPP 18, Glasgow, 21 st March 2007 Tony Cass Leader, Fabric Infrastructure.
DPM CCRC - 1 Research and developments DPM status and plans Jean-Philippe Baud.
CERN, 29 August 2006 Status Report Riccardo Zappi INFN-CNAF, Bologna.
CERN IT Department CH-1211 Genève 23 Switzerland t Plans and Architectural Options for Physics Data Analysis at CERN D. Duellmann, A. Pace.
CERN IT Department CH-1211 Genève 23 Switzerland t EIS section review of recent activities Harry Renshall Andrea Sciabà IT-GS group meeting.
StoRM Some basics and a comparison with DPM Wahid Bhimji University of Edinburgh GridPP Storage Workshop 31-Mar-101Wahid Bhimji – StoRM.
Status report on SRM v2.2 implementations: results of first stress tests 2 th July 2007 Flavia Donno CERN, IT/GD.
Status of SRM 2.2 implementations and deployment 29 th January 2007 Flavia Donno, Maarten Litmaath IT/GD, CERN.
SRM 2.2: status of the implementations and GSSD 6 th March 2007 Flavia Donno, Maarten Litmaath INFN and IT/GD, CERN.
Your university or experiment logo here NextGen Storage Shaun de Witt (STFC) With Contributions from: James Adams, Rob Appleyard, Ian Collier, Brian Davies,
CCRC’08 Weekly Update Plus Brief Comments on WLCG Collaboration Workshop Jamie Shiers ~~~ WLCG Management Board, 29 th April 2008.
CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 1 Tier0 Status Tony Cass LCG-LHCC Referees Meeting 18 th November 2008.
CERN IT Department CH-1211 Genève 23 Switzerland t Castor development status Alberto Pace LCG-LHCC Referees Meeting, May 5 th, 2008 DRAFT.
08/30/05GDM Project Presentation Lower Storage Summary of activity on 8/30/2005.
Your university or experiment logo here GridPP Storage Future Jens Jensen GridPP workshop RHUL, April 2010.
MW Readiness Verification Status Andrea Manzi IT/SDC 21/01/ /01/15 2.
Light weight Disk Pool Manager experience and future plans Jean-Philippe Baud, IT-GD, CERN September 2005.
Report on Installed Resource Capacity Flavia Donno CERN/IT-GS WLCG GDB, CERN 10 December 2008.
INFSO-RI Enabling Grids for E-sciencE Enabling Grids for E-sciencE Pre-GDB Storage Classes summary of discussions Flavia Donno Pre-GDB.
WLCG Grid Deployment Board, CERN 11 June 2008 Storage Update Flavia Donno CERN/IT.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Data Management cluster summary Krzysztof Nienartowicz JRA1 All Hands meeting, Helsinki.
Maarten Litmaath (CERN), GDB meeting, CERN, 2006/06/07 SRM v2.2 working group update Results of the May workshop at FNAL
CERN SRM Development Benjamin Coutourier Shaun de Witt CHEP06 - Mumbai.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Priorities update Andrea Sciabà IT/GS Ulrich Schwickerath IT/FIO.
CERN IT Department CH-1211 Genève 23 Switzerland t Load Testing Dennis Waldron, CERN IT/DM/DA CASTOR Face-to-Face Meeting, Feb 19 th 2009.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT DPM / LFC and FTS news Ricardo Rocha ( on behalf of the IT/GT/DMS.
DPM Python tools Ivan Calvet IT/SDC-ID DPM Workshop 10 th October 2014.
Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS XROOTD news New release New features.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Upcoming Features and Roadmap Ricardo Rocha ( on behalf of the.
CERN IT Department CH-1211 Genève 23 Switzerland t HEPiX Conference, ASGC, Taiwan, Oct 20-24, 2008 The CASTOR SRM2 Interface Status and plans.
INFSO-RI Enabling Grids for E-sciencE SRMv2.2 in DPM Sophie Lemaitre Jean-Philippe.
Report from GSSD Storage Workshop Flavia Donno CERN WLCG GDB 4 July 2007.
GridPP storage status update Joint GridPP Board Deployment User Experiment Update Support Team, Imperial 12 July 2007,
WLCG Grid Deployment Board CERN, 14 May 2008 Storage Update Flavia Donno CERN/IT.
CERN IT Department CH-1211 Genève 23 Switzerland t SL(C) 5 Migration at CERN CHEP 2009, Prague Ulrich SCHWICKERATH Ricardo SILVA CERN, IT-FIO-FS.
SRM v2.2 Production Deployment SRM v2.2 production deployment at CERN now underway. – One ‘endpoint’ per LHC experiment, plus a public one (as for CASTOR2).
EGEE-II INFSO-RI Enabling Grids for E-sciencE Data Management cluster summary David Smith JRA1 All Hands meeting, Catania, 7 March.
Developments for tape CERN IT Department CH-1211 Genève 23 Switzerland t DSS Developments for tape CASTOR workshop 2012 Author: Steven Murray.
INFSO-RI Enabling Grids for E-sciencE Enabling Grids for E-sciencE Storage Element Model and Proposal for Glue 1.3 Flavia Donno,
BNL dCache Status and Plan CHEP07: September 2-7, 2007 Zhenping (Jane) Liu for the BNL RACF Storage Group.
Grid Deployment Board 5 December 2007 GSSD Status Report Flavia Donno CERN/IT-GD.
1 SRM v2.2 Discussion of key concepts, methods and behaviour F. Donno CERN 11 February 2008.
The Grid Storage System Deployment Working Group 6 th February 2007 Flavia Donno IT/GD, CERN.
CERN IT Department CH-1211 Genève 23 Switzerland t CCRC’08 Review from a DM perspective Alberto Pace (With slides from T.Bell, F.Donno, D.Duelmann,
Martina Franca (TA), 07 November Installazione, configurazione, testing e troubleshooting di Storage Element.
SRM 2.2: experiment requirements, status and deployment plans 6 th March 2007 Flavia Donno, INFN and IT/GD, CERN.
Security recommendations DPM Jean-Philippe Baud CERN/IT.
DPM: Future Proof Storage Ricardo Rocha ( on behalf of the DPM team ) EMI INFSO-RI
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Standard Protocols in DPM Ricardo Rocha.
EMI is partially funded by the European Commission under Grant Agreement RI Future Proof Storage with DPM Oliver Keeble (on behalf of the CERN IT-GT-DMS.
CERN IT Department CH-1211 Genève 23 Switzerland t DPM status and plans David Smith CERN, IT-DM-SGT Pre-GDB, Grid Storage Services 11 November.
LCG Introduction John Gordon, STFC GDB December 7 th 2010.
Nov 05, 2008, PragueSA3 Workshop1 A short presentation from Owen Synge SA3 and dCache.
Jean-Philippe Baud, IT-GD, CERN November 2007
StoRM: current status and developments
Status of the SRM 2.2 MoU extension
SRM v2.2 / v3 meeting report SRM v2.2 meeting Aug. 29
DPM Python tools Andrea Manzi CERN DPM Workshop 07th December 2015.
SRM2 Migration Strategy
Proposal for obtaining installed capacity
Presentation transcript:

CERN IT Department CH-1211 Geneva 23 Switzerland t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, November 2008

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Introduction Detailed status report already available –Pre-GDB (dCache, DPM, StoRM) –WLCG workshop (CASTOR) ionId=1&materialId=slides&confId= ionId=1&materialId=slides&confId=32660 Summary of the recommended versions and features available now or in the near future

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services CASTOR The release currently in production is: - CASTOR Core: CASTOR SRM v2.2: on SLC3 The recommended release is: - CASTOR Core: (released this week) - CASTOR SRM v2.2: on SLC4 (srmCopy, srmPurgeFromSpace, more robust) The next version of CASTOR, 2.1.8, is being considered for deployment at CERN for the experiment production instances.

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services dCache Recommended release is –It is a low risk upgrade from –Sites are recommanded to install Fast PNFS 1.9.n (n>=1) contains the actual new features –New pool code (November) – Copy and Draining Manager –PinManager (December, January) –gPlazma –Tape protection (MoU) –srmReleaseFiles based on FQAN (MoU) –Space Token protection (MoU) –New information providers –ACLs(January) –NFS v4.1 –Bug Fixes (gsiDcap, UNAVAILABLE Files, etc.)

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services dCache future development Catalogue synchronization Better information providers for installed capacity Glue 2.0 Fast Pnfs to Chimera migration tool For more info, please refer to the pre-GDB presentation.

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services DPM V is the last stable release on SLC4 (August 2008) V currently in certification –srmCopy –Write permission to spaces limited to multiple groups (MoU) –srmReleaseFiles based on FQAN (MoU) –srmLs can return a list of spaces a given file is in –New dpm-listspace command needed for information providers (installed capacity) –DPM retains space token when the admin drains a file from a filesystem

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services DPM –Added ADLER32 and CRC32 supported checksum in the gridftp CKSM command –New nameserver APIs to set and retrieve checksum –SURL cleanup after expiry or abort –Improved internal logging for space capacity updates –New DB schema YAIM makes an automatic update

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services DPM future plans More friendly python interface Enhance xrootd support (authentication) Quota system Further checksum support Monitoring interface Tool for consistency check and repair Enhance filesystem selection NFS v4.1 Resource limits Compliance with gLite logging recommandations

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services StoRM V currently in production –Support for SL4 –YAIM configuration –Filesystem drivers PosixFS – Lustre, EXT3, etc. –ACL enforcing through setf/getfacl GPFS v3.x XFS V1.4 new major release (December 2008) –Compliant with MoU short term plan –GSOAP 2.7 –Separation of Synch and Asynch srm call –Improved configuration –New authorization mechanism for SA –GridFTP load balancer –Improved support for different filesystems –Storage Area size not enforced at filesystem level