1. CMS Luigi Zangrando, Cern, 05/03/2002 1 RCMS for XDaq based small DAQ Systems M. Gulmini, M. Gaetano, N. Toniolo, S. Ventura, L. Zangrando INFN – Laboratori Nazionali di Legnaro

2. CMS Luigi Zangrando, Cern, 05/03/2002 2 RCMS: definition The Run Control Monitor System is defined as the software required to: configure and set the CMS apparatus ( partitions or whole system) configure and set the CMS apparatus ( partitions or whole system) control and synchronize operation of the separate components control and synchronize operation of the separate components monitor the separate components monitor the separate components handle errors and information messages handle errors and information messages log continuously the current state of the experiment log continuously the current state of the experiment provide a user interface for both control and monitor provide a user interface for both control and monitor RCMS Internet Intranet Internet Intranet UI The RCMS architecture enables the users to access and control the experiment from any part of the world

3. CMS Luigi Zangrando, Cern, 05/03/2002 3 RCMS context Session Manager UI Services Connection Services Services EVB Ctrl CS Ctrl TRG Ctrl DCS Ctrl EVF Ctrl RUs EVM BUs CS Sub - System Glbl Mu Cal DCS Sub - System EVB Sub-System TRG Sub-System EVF Sub-System RCMS

4. CMS Luigi Zangrando, Cern, 05/03/2002 4 RCMS: block diagram Services Connection Session Manager Sub-System Controllers RCMS GUI resources resources resources Security service Resource service Info & Mon s. Job Control Problem Solver services services db db db

5. CMS Luigi Zangrando, Cern, 05/03/2002 5 RCMS status Services Connection GUI resources Session Manager Sub-System Controllers RCMS Security service Resource service Info & Mon s. Job Control services services Problem Solver db db db

6. CMS Luigi Zangrando, Cern, 05/03/2002 6 Tools: APACHE TOMCAT Services Session Manager Sub-System Controllers Servlet container APACHE TOMCAT HTML client C++ client Java client

7. CMS Luigi Zangrando, Cern, 05/03/2002 7 Tools: XML as communication protocol Services Session Manager Sub-System Controllers Servlet container APACHE TOMCAT XML / HTTP HTML client C++ client Java client XML / HTTP

8. CMS Luigi Zangrando, Cern, 05/03/2002 8 Scalability: multiple containers allocated in different server machines Internet - Intranet Session Manager Sub-System Controllers Session Manager Sub-System Controllers Services Servlet container

9. CMS Luigi Zangrando, Cern, 05/03/2002 9 Tools: XML Database XML databases represent a new technology that surpass the traditional data storage mechanism in convenience, ease of development. The benefit of a XML DB solution is that: 1. 1.we don't have to worry about mapping our XML to some other data structure. We just insert the data as XML and retrieve it as XML. 2. 2.we gain a lot of flexibility through the semi-structured nature of XML. This is especially valuable when we have very complex XML structures that would be difficult or impossible to map to a more structured database. Disadvantage: the performances are not good Characteristics: – –XML data is either stored in the internal native XML-DB or an external RDBMS – –The server is accessible through easy to use HTTP and XML-RPC interfaces and supports the XML:DB API for Java programming. – –the search engine supports XPath queries. Links: http://www.xmldb.org – http://exist.sourceforge.net – http://www.ozone-db.org - http://xml.apache.org/xindice/http://www.ozone-db.org

10. CMS Luigi Zangrando, Cern, 05/03/2002 10 resources Sub-System Controllers Session Manager services Sub-System Controller resources RCMS: logical view run session GUI GUI Def. run session: hardware and software needed to operate a physic or test run with the whole or a partition of CMS apparatus A run session is composed by all or some sub-systems and, inside a given sub-system, by a selected partition of its resources

11. CMS Luigi Zangrando, Cern, 05/03/2002 11 GUI Session Manager services Sub-System Controller A resources GUI Session Manager Sub-System Controller A resources run session 1 run session 2 Run session concurrency and services shared The are shared are shared Multiple run session may coexist and run concurrently. Every activated run session has the own Session Manager that is in charge to coordinate the specific run session. Partition 1 Partition 2

12. CMS Luigi Zangrando, Cern, 05/03/2002 12 Run Session: example 1)The user makes login and receives own profile 2)The user requires to RS the session list 3)Session activation or session join 4)The user send commands ( start, stop, etc ) GUI login profile Security Service 1 2 session list session list? Session Manager Resource Service 3 Sub-System Controller 4 start start start start active Resources session partition

13. CMS Luigi Zangrando, Cern, 05/03/2002 13 Function Manager and XDAQ adapter Session Manager Sub-System Controller XML XML XML Resources Resources Resources Function Manager XDAQ adapter Resources Resources Resources XDAQ rs. XML GUI XML T he FM is a function engine receiving requests from a SM and transforming them in the proper requests of actions to be sent to the sub-system resource Every SSC receives commands from the SM and dispatches them to its own DAQ resources

14. CMS Luigi Zangrando, Cern, 05/03/2002 14 XDAQ Adapter: block diagram xdaq adapter commands: clear, configure, enable, halt, reset, resume, suspend RS Protocol XML XDaq Protocol xdaq xdaq adapter command-engine cmd + RS object cmd + xdaq DOM node SOAP message A XML protocol adapter has been developed to be included in the Function Manager to convert on the flight the Resource Service Protocol into XDAQ Protocol

15. CMS Luigi Zangrando, Cern, 05/03/2002 15 Function Manager xdaq adapter command-engine Resource Service xdaq xdaq xdaq Session manager XDAQ Adapter - Function Manager GUI Session Partition Session’s list

16. CMS Luigi Zangrando, Cern, 05/03/2002 16 Finite State Machine (FSM) Function Managers have a built in FSM to track the status of the related controlled components. The FSM is composed of a XML definition and a Java class implementation reppresenting the actions to be performed. FSM XML definition Java implementation Both definition and implementation are managed by the Resource Service Function Manager FSM XML definition Java implementation Resource Service FSM XML definition Java implementation FSM XML definition Java implementation FSM XML definition Java implementation download def. + impl.

17. CMS Luigi Zangrando, Cern, 05/03/2002 17 SM-FM implementation The XDAQ adapter implements every command defined in the State Machine The XDAQ adapter implements every command defined in the State Machine GUI XML XML Security Service XML Session Manager Resource Service XML XML Java Java Java State Machine XDAQ adapter Java XDAQ rs. FSM XML definition Java implementation XDAQ adapter

18. CMS Luigi Zangrando, Cern, 05/03/2002 18 Information and Monitor Service (IMS) The IMS collects all the information comming from any DAQ resources or RCMS internal components and stores them in the logDB database. The informations are cataloged in: Messages (error, generic, resource status change) Messages (error, generic, resource status change) Monitor Monitor SM FM FM error msg status change msg IMS

19. CMS Luigi Zangrando, Cern, 05/03/2002 19 IMS: information structure time stamp info type specific fields msg id source id time stamp (T): when the message/monitor information has been generated information type (IType): error, generic, status change, monitor msg id (MId): Message/Monitor Identification (Id) source id (SId): the source of the information identified univocally by the session, sub- syste, partition, software application and hardware board specific fields (SFields) whose definition is according to the information type errors (severity level {none, severe, fatal, abort}, description) errors (severity level {none, severe, fatal, abort}, description) generic (description) generic (description) resource status change (status definition) resource status change (status definition) monitor (these fields are defined according to theapplication to monitor and to the parameters to acquire. These fields could contain values, tables, histograms, event dumps) monitor (these fields are defined according to theapplication to monitor and to the parameters to acquire. These fields could contain values, tables, histograms, event dumps)

20. CMS Luigi Zangrando, Cern, 05/03/2002 20 IMS prototype: Resource Status Change Error Statistics Message Logger (DB) State logger Monitor - History DB Message Filtering and Dispatcher Monitor Info System State Display Error Statistics Alarm Display Monitor Systems Client Subscriber Messages (Error, Warning Generic) msg message queue IMS DB FilterEngine XPath based msg subscriber 1 subscriber n

21. CMS Luigi Zangrando, Cern, 05/03/2002 21 RCMS prototype status done: done: Resource Service with Security ServiceResource Service with Security Service Session ManagerSession Manager Function Manager (with XDaq adapter)Function Manager (with XDaq adapter) To be done (before April 2002): IMS with at least logger and book keeping functionalityIMS with at least logger and book keeping functionality GUIGUI Integration with small daq systems (test beam)Integration with small daq systems (test beam)

22. CMS Luigi Zangrando, Cern, 05/03/2002 22 RCMS for small DAQ system demonstrators PC1 PC2 PC3 PC4 Tomcat SM FM FM UI XDAQ resources A single java servlet container has been used, but all the RCMS components comunicate by XML documents over http also if they are in the same container

23. CMS Luigi Zangrando, Cern, 05/03/2002 23 Next Step: web services We want to increase the system’s scalability using multiple containers (e.g. one container per service) allocated in different server machines. We need a service locator (network DNS), as the services will be dislocate over the network. Web Service tecnology can be used for that. Service 1 Service n UDDI WSDL The single servlet container describes the services they offer by means of the Web Service Description Language (WSDL) and then publish it to the Universal Description Discovery and Integration (UDDI) registries client Service 1 Clients looking for services, query first the UDDI server to discover the location of the service and then access to it Tomcat 1 Tomcat 2

24. CMS Luigi Zangrando, Cern, 05/03/2002 24 Web Services products suitable for our application Java Web Service Developer Pack (WSDP)Java Web Service Developer Pack (WSDP) –UDDI –WSDL –TomCat SilverStreamSilverStream Oracle Java Developer PackageOracle Java Developer Package Etc.Etc.

25. CMS Luigi Zangrando, Cern, 05/03/2002 25 Conclusions A RCMS prototype to be integrated in small daq systems (test beams, validation chamber, etc.) will be soon ready (April 2002).A RCMS prototype to be integrated in small daq systems (test beams, validation chamber, etc.) will be soon ready (April 2002). Most of the RCMS components have been developed and tested.Most of the RCMS components have been developed and tested. A first implementation of the IMS (Information and monitor service) will be delivered in the next few weeks.A first implementation of the IMS (Information and monitor service) will be delivered in the next few weeks. A new RCMS prototype targeted to test the scalability of the system and based on the web service technology is expected for June.A new RCMS prototype targeted to test the scalability of the system and based on the web service technology is expected for June.