DPM releases and platforms status

Slides:



Advertisements
Similar presentations
HDFS and S3 plugins Andrea Manzi Martin Hellmich 13/12/2013.
Advertisements

Storage: Futures Flavia Donno CERN/IT WLCG Grid Deployment Board, CERN 8 October 2008.
O. Keeble, F. Furano, A. Manzi, A. Ayllon, I. Calvet, M. Hellmich DPM Workshop 2014 DPM Monitoring.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Release Process Maria Alandes Pradillo.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
Storage Wahid Bhimji DPM Collaboration : Tasks. Xrootd: Status; Using for Tier2 reading from “Tier3”; Server data mining.
CERN IT Department CH-1211 Geneva 23 Switzerland t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, November 2008.
Configuration Management with Cobbler and Puppet Kashif Mohammad University of Oxford.
New DM Clients and retirement plans for old ones Alejandro Alvarez Ayllon on behalf of the DM Clients developers IT/SDC 11/12/2013.
Wahid, Sam, Alastair. Now installed on production storage Edinburgh: srm.glite.ecdf.ed.ac.uk  Local and global redir work (port open) e.g. root://srm.glite.ecdf.ed.ac.uk//atlas/dq2/mc12_8TeV/NTUP_SMWZ/e1242_a159_a165_r3549_p1067/mc1.
MW Readiness Verification Status Andrea Manzi IT/SDC 21/01/ /01/15 2.
March 11, 2008 USCMS Tier-2 Workshop Oh Dear God Alain made a PowerPoint presentation 1.
Alejandro Alvarez Ayllon on behalf of the LCGDM developer team IT/SDC 13/12/2013 DAV support in DPM.
WebFTS File Transfer Web Interface for FTS3 Andrea Manzi On behalf of the FTS team Workshop on Cloud Services for File Synchronisation and Sharing.
Information System Status and Evolution Maria Alandes Pradillo, CERN CERN IT Department, Grid Technology Group GDB 13 th June 2012.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT DPM Collaboration Motivation and proposal Oliver Keeble CERN On.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT DPM / LFC and FTS news Ricardo Rocha ( on behalf of the IT/GT/DMS.
DPM Python tools Ivan Calvet IT/SDC-ID DPM Workshop 10 th October 2014.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Tools and techniques for managing virtual machine images Andreas.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Standard Interfaces to Grid Storage DPM and LFC Update Ricardo.
2012 Objectives for CernVM. PH/SFT Technical Group Meeting CernVM/Subprojects The R&D phase of the project has finished and we continue to work as part.
Puppet management for DPM Martin Hellmich Andrea Manzi IT/SDC
WLCG Software Lifecycle First ideas for a post EMI approach 0.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Upcoming Features and Roadmap Ricardo Rocha ( on behalf of the.
IT-SDC : Support for Distributed Computing DPM workshop 2015 Speaker: Fabrizio Furano, on behalf of the DPM team.
Andrea Manzi CERN On behalf of the DPM team HEPiX Fall 2014 Workshop DPM performance tuning hints for HTTP/WebDAV and Xrootd 1 16/10/2014.
DMLite GridFTP frontend Andrey Kiryanov IT/SDC 13/12/2013.
EMI is partially funded by the European Commission under Grant Agreement RI Roadmap & Future Work Ricardo Rocha ( on behalf of the DPM team )
MW Readiness WG Update Andrea Manzi Maria Dimou Lionel Cons Maarten Litmaath On behalf of the WG participants GDB 09/09/2015.
Andrea Manzi CERN EGI Conference on Challenges and Solutions for Big Data Processing on cloud 24/09/2014 Storage Management Overview 1 24/09/2014.
The Great Migration: From Pacman to RPMs Alain Roy OSG Software Coordinator.
The HEPiX IPv6 Working Group David Kelsey (STFC-RAL) EGI OMB 19 Dec 2013.
DPM: Future Proof Storage Ricardo Rocha ( on behalf of the DPM team ) EMI INFSO-RI
EMI is partially funded by the European Commission under Grant Agreement RI DPM in EMI-II HTTP and NFS interfaces Oliver Keeble On behalf of DPM.
Accounting Update John Gordon. Outline Multicore CPU Accounting Developments Cloud Accounting Storage Accounting Miscellaneous.
EMI is partially funded by the European Commission under Grant Agreement RI Future Proof Storage with DPM Oliver Keeble (on behalf of the CERN IT-GT-DMS.
CERN IT Department CH-1211 Genève 23 Switzerland t DPM status and plans David Smith CERN, IT-DM-SGT Pre-GDB, Grid Storage Services 11 November.
ALICE WLCG operations report Maarten Litmaath CERN IT-SDC ALICE T1-T2 Workshop Torino Feb 23, 2015 v1.2.
Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.
HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP33 Ambleside 22 Aug 2014.
WLCG Operations Coordination Andrea Sciabà IT/SDC GDB 11 th September 2013.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI MPI VT report OMB Meeting 28 th February 2012.
dpm-xrootd status for xroot federations David Smith CERN DPM Workshop 07/12/2015 dpm-xrootd2.
Sitecore upgrades The Past, The Present, The Future.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Middleware Update GDB, 9 th February 2011 Slides by Maria Alandes.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Middleware updates Peter Solagna – EGI.eu OMB – 16/07/ /3/
SA2.6 Task: EMI Testbeds Danilo Dongiovanni INFN-CNAF.
WLCG IPv6 deployment strategy
DPM at ATLAS sites and testbeds in Italy
OpenSSL and Java 7 vs. 512-bit proxy keys
EGI Operations Management Board
Ricardo Rocha ( on behalf of the DPM team )
Andrea Manzi, Oliver Keeble
CREAM Status and Plans Massimo Sgaravatto – INFN Padova
Grid status ALICE Offline week Nov 3, Maarten Litmaath CERN-IT v1.0
Update on Plan for KISTI-GSDC
DPM Python tools Andrea Manzi CERN DPM Workshop 07th December 2015.
Windows 7 deployment at CERN
GFAL 2.0 Devresse Adrien CERN lcgutil team
EGI UMD Storage Software Repository (Mostly former EMI Software)
EMI: dal Produttore al Consumatore
DPM and SRM-less operation
UMD update 11 Joao Pina (EGI/LIP).
IPv6 transition Vincenzo Spinoso EGI Operations.
Operations Officer, EGI
New Types of Accounting Beyond CPU
Andrea Manzi, Oliver Keeble
UMD Updates Vincenzo Spinoso.
System Center Third Party Tools Ivanti Patch and RCT Recast April 2019.
Presentation transcript:

DPM releases and platforms status Andrea Manzi CERN DPM Workshop 08/12/2015

DPM Releases and platforms status Outline Repositories Releases status DPM ( legacy services) Metapackages dmlite and plugins dpm-gsiftp dpm-xrootd lcgdm-dav Platforms Status CentOS7 SL5 08/12/2015 DPM Releases and platforms status

DPM Releases and platforms status Repositories All 1.8.10 components are available in EPEL except for: Metapackages (EMI3), vomsxrd (WLCG), glite-info-provider ( EMI3 & WLCG) Under Staged Rollout for the inclusion in UMD 3 Most probably before Xmas 08/12/2015 DPM Releases and platforms status

DPM Releases and platforms status Release Status - DPM DPM 1.8.10 this year, no changes in legacy compos 49 instances in EGI already upgraded DPM releases in the past 3 years have always followed a wrong schema: Increment patch number whatever is the change 1.8.9 had lot of big changes compared to 1.8.8 The idea is to have proper version numbering starting from the next version 1.9.0 ( to be scheduled) will be the next version First version fully supporting CentOS7 08/12/2015 DPM Releases and platforms status

Release Status - metapackages Puppet manifest are now driving the installation of the different nodes (head, disk , head+disk) There is not need for metapackages to group together the correct packages to install per node Metapackages force us to delay releases for inclusion in EMI repo ( whose future is not clear) From the next release ( 1.9.0) we would like to propose to drop metapackages What is your opinion? 08/12/2015 DPM Releases and platforms status

Release Status – dmlite and plugins dmlite 0.7.3 /0.7.5 released this year Includes core, adapter plugin, mysql plugin, memcache plugin, shell etc etc Several improvement and bug fixes dmlite 0.7.6 with other bug fixes beg next year dmlite-plugins-hdfs 0.7.3/0.7.4 Bug fixes following the Bristol installation 0.7.5 beg of next year Support for HA dmlite-plugins-s3 & dmlite-plugins-profiler untouched 08/12/2015 DPM Releases and platforms status

Release Status – dpm-gsiftp Several releases this year due to the strict dependency towards globus-gridftp-server ( passed from v 7.3 to 9.3 in few months..) Stable version is 1.9.5-12 ( compatible with globus-gridftp-server 9.1) 1.9.5-13 + globus-gridftp-server 9.3 in epel-testing now Next version is 1.9.7, with bug fixes and enabled calculation of checksum on disknodes in case of redirection, to be released soon 08/12/2015 DPM Releases and platforms status

Release Status – dpm-xrootd 3.5.2 with Xrootd 4 support released at the beginning of the year 3.5.5 released in order to fix a problem in AAA It has an issue with xrootd dependency 3.6.0 ( to epel-testing before Xmas) Federation performance improvements Fix xrootd dependency 3.7.0 ( March 2016) Full CentOS7 support 08/12/2015 DPM Releases and platforms status

Release Status – lcgdm-dav 0.15 Several bug fixes ( also for crashes) Removed support for SSL v3 Added robots.txt for crawlers 0.16 Support for Space reporting New DPMBox packaging issues, fixed in 0.16.0-2 now in epel-testing 0.17 ( next year) Remove weak Ciphers from the conf Support for pull third party copy Conf changes for httpd 2.4 ( CentOS7) 08/12/2015 DPM Releases and platforms status

DPM Releases and platforms status Platforms – CentOS7 Test machines deployed on CentOS7 @ CERN and Glasgow Thanks to Sam for the help! Some issues with systemd files have been fixed Puppet modules extended in order to properly configured some services for CentOS7 Still some issues with dpm-xrootd May be needed also some changes on xrootd side Some components are not available yet on EPEL7 nagios-plugins-lcgdm dpm-contrib-admin-tools 08/12/2015 DPM Releases and platforms status

DPM Releases and platforms status Platforms – CentOS7 As soon are we are ready we would like also to ask other sites help for testing Migration from MySQL 5.1 to MariaDB 5.5 needs to be tested as well Got interest from: A. Sartirana R. Cardoso Are the current testbeds willing to move to CentOS7? Expected full version compatible with CentOS7 in Spring 2016 We expect mixed installation first ( e.g. Head node SL6 + Disk nodes SL6/CentOS7) 08/12/2015 DPM Releases and platforms status

DPM Releases and platforms status Platforms – SL5 SL5 end of support is March 2017 but.. EGI has already planned to phase out any SL5 installation by April 2016 WLCG will follow Therefore we have decided to drop support for SL5 in the same period Given that we will support CentOS7 soon we encourage all site admins to move to SL6 or wait for CentOS7.. 08/12/2015 DPM Releases and platforms status

Questions?