Tango archiving @ SOLEIL http://www.tango-controls.org/ 24/02/2019 G. Abeillé - SOLEIL

Software architecture Device Archiver Collect data Insert Database Device Monitor health Tango Control system Watcher 24/02/2019

SOLEIL Archiving system Computer room 1 Normal service Computer room 2 Degraded service VM Cluster Tango Devices Replica VM Cluster Tango Devices 3 nodes Oracle RAC DB  Degraded  Oracle DB Business continuity Disaster Recovery Time: toutes les 4 heures, les données de conf d'archivage (tables ADT,APT,AMT) sont recopié dans une base de données stand alone distante (salle RGI1). un script permet de changer la chaine de connexion des device d'archivage (temps d'execution : 2 secondes). pour activer le PRA (passer en mode dégradé), il faut lancer le script et redémarrer les devices d'archivage durée de recopie des données du PRA vers la PROD: environ 1 heure par jour à recopier. Le PRA est mise en place pour HDB machine, HDB ligne, SNAP ligne   Machine HDB TDB SNAP Beamlines HDB Snap Machine HDB SNAP Beamlines HDB SNAP

Figures System Attributes Rate Database HistoricalDB on Accelerators 17368 attrs 700 insert/sec 7 TB 100GB/month TemporaryDB on 9400 attrs 4000  insert/sec 20 GB/day Erase up at every shutdown HDB on 29 Beamlines 4700 attrs 1   insert/sec 1.1 TB 50 GB / month

Accelerator Running Devices 270 HDBArchiver devices 300 TDBArchiver devices Archivers are now deployed on virtual servers … Rajouter la même pour 1 ou 2 lignes

Beamlines Running devices 5 HDBArchiver devices per beamline

Latest changes The SOLEIL archiving system is in operation since many years Considering that SOLEIL’s users are not demanding so many new features, the latest changes are only minor bug fixes and evolutions: Possibility to run SQL requests with a new GUI DataBaseConnection tester Archivers devices: Better reconnection mechanism in case of database connection loss Archivers : add a cache for attribute ids to avoid database overload Better information messages in the watcher device

Proposals for the future The Tango Archiving system still has to evolve to provide a better quality of service and face future challenges. OPEN to discussions: HDB/TDB Archivers performances enhancement Simplify operation of the archiving system: Provide keys indicators and rise alarms as soon an error occurs Better Tango events management in Archiving API Towards a common functional extraction API for all tango bindings Make Mambo compatible with hdb++ extraction API Study of a use case for NoSQL hdb++ for SOLEIL Propose an extraction service with integrated data decimation to extract big volumes of data 24/02/2019 G. Abeillé, A.Buteau, N.Leclercq : SOLEIL

Conclusion Reminder : Last Archiving package is available on Tango green site (tools): http://www.tango-controls.org/downloads/tools/ (last release = 16.2.4) Features requests or bug tracking Please use the SourceForge tracker

G. Abeillé, A.Buteau, N.Leclercq : SOLEIL Thank you! Any questions? 24/02/2019 G. Abeillé, A.Buteau, N.Leclercq : SOLEIL