!CHAOS: a Cloud of Controls Workshop CCR – Frascati 25-29 Maggio 2015 Michele Tota on behalf of !CHAOS project

A Cloud of Controls Design and implementation of a prototype of Control as a Services: an infrastructure at national level which offers a cloud of services and procedures distributed and shared over the LAN/WAN, to monitor and control any hardware device, system or intelligent component and which provides resources to processing services, data logging and archiving. Workshop CCR – Frascati 25-29 Maggio 2015

Why, when & where the project started plant → sensors/actuators → front-end → control room Workshop CCR – Frascati 25-29 Maggio 2015

front-end controllers control room device front-end controllers Workshop CCR – Frascati 25-29 Maggio 2015

\16\00\00\00\02hello\00\06\00\00\00world\00\00 control room object caching BSON (Binary JSON) \16\00\00\00\02hello\00\06\00\00\00world\00\00 device control units (CUs) Workshop CCR – Frascati 25-29 Maggio 2015

control room control units (CUs) NoSQL DB data management (CDS) device Workshop CCR – Frascati 25-29 Maggio 2015

control room EU control units (CUs) Workshop CCR – Frascati 25-29 Maggio 2015

control room control units (CUs) Metadata server system dynamic configuration device control units (CUs) Workshop CCR – Frascati 25-29 Maggio 2015

control units (CUs) Controls & DAQ device Workshop CCR – Frascati 25-29 Maggio 2015

Workshop CCR – Frascati 25-29 Maggio 2015 Realization of a prototype of Control as a Services open platform suited for a large number of applications in science, industries and society devices Control Units GUIs Workshop CCR – Frascati 25-29 Maggio 2015

!CHAOS strong points EFFICIENCY Custom transfer protocol Support for standard protocol (RESTful) easier to use or to implement higher efficiency VS insane overhead HTTP / RESTful Custom protocol Workshop CCR – Frascati 25-29 Maggio 2015

!CHAOS strong points HETEROGENEITY Data abstraction with binary serialization (binary JSON) Support for heterogeneous hw Linux kernel 2.6+ Others can use !CHAOS Lite Workshop CCR – Frascati 25-29 Maggio 2015

!CHAOS strong points SCALABILITY Specifically designed to be a flexible and a scalable system In-memory cache CU NoSQL DB CU … CU Persistent storage Workshop CCR – Frascati 25-29 Maggio 2015

!CHAOS infrastructure Workshop CCR – Frascati 25-29 Maggio 2015

Back-end services: in-memory cache CU write CDS read/write EU CDS CDS read CDS instances UI scalability high performance and low latency on write operations Workshop CCR – Frascati 25-29 Maggio 2015

Back-end services: in-memory cache Couchbase NoSQL DB Persistent storage Workshop CCR – Frascati 25-29 Maggio 2015

Back-end services: NoSQL database Needs to retrieve data fragments from stage Data indexing for history Insert, update and search operations High availability Scalability Atomic find/modify operation Workshop CCR – Frascati 25-29 Maggio 2015

Back-end services: MongoDB Workshop CCR – Frascati 25-29 Maggio 2015

Back-end services: NoSQL database In-memory cache Couchbase NoSQL DB MongoDB Persistent storage Workshop CCR – Frascati 25-29 Maggio 2015

Back-end services: persistent storage Read random access Write sequential access High availability Redundancy Fault tolerance Recovery Object storage analysis + FUSE Workshop CCR – Frascati 25-29 Maggio 2015

Back-end services: persistent storage In-memory cache Couchbase NoSQL DB MongoDB Persistent storage Ceph Workshop CCR – Frascati 25-29 Maggio 2015

Private and/or Pubblic Cloud !CHAOS deployment Control Unit Execution Unit User Interface OpenVPN Cloud !CHAOS Services CDS CDS CDS MDS MDS MDS Back-end services Ceph / FS Cluster MongoDB Cluster Couchbase Private and/or Pubblic Cloud Workshop CCR – Frascati 25-29 Maggio 2015

!CHAOS deployment: state of the art Control Unit Execution Unit User Interface OpenVPN Cloud !CHAOS Services CDS CDS CDS MDS MDS MDS Back-end services Ceph Cluster Mongo DB Cluster Couchbase OpenStack (CNAF / LNF) Workshop CCR – Frascati 25-29 Maggio 2015

!CHAOS on multi-site infrastructure OpenStack availability zone Ceph geografical Workshop CCR – Frascati 25-29 Maggio 2015

!CHAOS@BTF test-bed FROM SINGLE MAGNET CONTROL IT developed for !CHAOS BTF DIAGNOSTICS accessing !CHAOS IT developed for !CHAOS UP TO DAFNE MAG TERMINAL Workshop CCR – Frascati 25-29 Maggio 2015

!CHAOS@AulaTouschek Monitoring http://chaost-webui1.chaos.lnf.infn.it/Ed36.html Workshop CCR – Frascati 25-29 Maggio 2015

!CHAOS mobile application Workshop CCR – Frascati 25-29 Maggio 2015

http://www.frascatiscienza.it/chaosContest/ Workshop CCR – Frascati 25-29 Maggio 2015

Who is who + Workshop CCR – Frascati 25-29 Maggio 2015 WP Workpackage title Lead WP1 MANAGEMENT & DISSEMINATION INFN-LNF WP2 ARCHITECTURE SOFTWARE DEVELOPMENT Uni. TV WP3 FRONTEND DRIVERS & INTEGRATION INFN-LNS ADF &NI WP4 HARDWARE DEVELOPMENT INFN-TV INFN-PG WP5 IT INFRASTRUCTURE & SERVICES, ACCESS POLICY COLLABORATIVE TOOLS INFN-CNAF INFN-LNF + Contact: WP2; C. Bisegni (LNF); WP3: A. Michelotti; WP4: G. Salina (TV); WP5 E. Fattibene (CNAF); Technical Manager: A. Stecchi (LNF); Project leader: G. Mazzitelli. Workshop CCR – Frascati 25-29 Maggio 2015