1. StoRM Troubleshooting session

2. Issues and Fix
StoRM-Tutorial for supporter, IGI, Bologna, Italy

3. Disable YUM automatic update
cron job
Remove any scripts doing the updates from cron directories (/etc/cron.*)
Remove any entries from /etc/crontab referring to the YUM update
yum-autoupdatesd
See:

4. Issue: Node synchronization
All the nodes participating to the StoRM service MUST be synchronized via NTP protocol.
NTP service MUST be installed and configured
StoRM-Tutorial for supporter, IGI, Bologna, Italy

5. Fix Node synchronization Issue
Install last NTP service
# yum install ntp
Configure NTP
Edit /etc/ntp.conf by adding lines dealing with your time server configuration
Activate NTPD service with the following command:
#ntpdate <your ntp server name>
#service ntpd restart
#chkconfid ntpd on
StoRM-Tutorial for supporter, IGI, Bologna, Italy

6. Host certificates
Front-End node MUST be configured with host certificates signed by a trusted Certification Authority (CA).
/etc/grid-security/hostkey.pem
$> chmod 0400 hostkey.pem
/etc/grid-security/hostcert.pem
$> chmod 0644 hostkey.pem
StoRM-Tutorial for supporter, IGI, Bologna, Italy

7. FS mounted with ACL and XATTR support
Verify if ACL and EA are enabled and working well

8. Hostname
Hostname MUST be set correctly, containg a Fully Qualified Domain Name (FQDN)
#cat /etc/hosts
StoRM-Tutorial for supporter, IGI, Bologna, Italy

9. Simple script to test the XATTR support
#!/bin/bash rm -f dummy_file_test_xattr touch dummy_file_test_xattr chown nobody:nobody dummy_file_test_xattr su -s/bin/bash nobody -c "setfacl -m g:bin:rw dummy_file_test_xattr" su -s/bin/bash nobody -c "getfacl dummy_file_test_xattr" su -s/bin/bash bin -c "setfattr -n user.test.xattr - v dummy_file_test_xattr" su -s/bin/bash bin -c "getfattr -d dummy_file_test_xattr"
StoRM-Tutorial for supporter, IGI, Bologna, Italy

10. Possible fixes for XATTR
Verify if the ‘attr’ package is installed
# yum install attr
Check if the FS is mounted with “user_xattr” support
# cat /etc/fstab
Remount the affected partition
# mount –o remount /storage
StoRM-Tutorial for supporter, IGI, Bologna, Italy

11. Check StoRM configuration
FE points to the right BE
Check BE hostname in FE configuration file (storm- frontend.conf)
BE knows all the FEs, alias included
Check FE hostnames and alias in BE configuration file (storm.properties)
FE and BE must use the same DBMS and DBs
Check connection parameters to DBMS (username and password must be the same for all the FEs and the BE).
StoRM-Tutorial for supporter, IGI, Bologna, Italy

12. Authentication and Authorization issues
AuthN and AuthZ issues represents the 90% of the issues.
Checks all the stuff:
Host certificates
*mapfiles
.lsc
StoRM-Tutorial for supporter, IGI, Bologna, Italy

13. Virtual Organization correctly installed
Check the directories:
/etc/storm/siteinfo/vo.d/
In the file named with the VO name:
/etc/storm/siteinfo/vo.d/testers.eu-emi.eu
Informations about VOMS_SERVERS, check the related LSC files:
/etc/grid-security/vomsdir/testers.eu- emi.eu/emitestbed01.cnaf.infn.it.lsc
/etc/grid-security/vomsdir/testers.eu- emi.eu/emitestbed07.cnaf.infn.it.lsc
StoRM-Tutorial for supporter, IGI, Bologna, Italy