DIP for LS2 – Technical Review Brice Copy, Eleni Mandilara, Ivan Prieto – 02 Sep 2016

Overview DIP requirements for LS2 DIP Contract Monitoring DIP Web Browser DIP Bridge BE-ICS2 02 September 2016

DIP Requirements for LS2 LHC Exp BE-CO BE-OP: Improve publication reliability ! How to deal with changes ? How can publishers and consumers agree ? LHC Exp: Integrate live DIP data in third-party websites ! Make some DIP data accessible from the Internet Allow simple web page reuse CNIC LHC Exp : Improve data accessibility across networks ! Allow GPN access Isolate GPN and TN consumers BE-ICS3 02 September 2016

DIP Requirements for LS2 (continued) Data Reliability : DIP Contract Monitoring : Introduction of MODESTI2 workflow to review publication changes. Reuse of current DIP Contract Monitoring definitions. Data Accessibility : DIP Bridge : A repeater that also provide namespace mappings across networks. (!) Introduction of a single-point of failure - we can split the DIP namespace across multiple bridges, but only ever on one process. Data Integration : DIP Web Browser : Support live monitoring of DIP data from the CERN Network, and possibly the Internet (for a selected subset). Provide simple reusable and scalable data broadcasting for simple integration into third-party web pages. BE-ICS4 02 September 2016

DIP Contract Monitoring (DIP CM) Use Case 1: Create/edit a contract (publisher/subscriber agreement) BE-ICS5 02 September 2016

DIP Contract Monitoring (DIP CM) Use Case 2: Publisher wants to edit existing publications BE-ICS6 02 September 2016

DIP Contract Monitoring (DIP CM) Use Case 3: Publisher wants to remove existing publications BE-ICS7 02 September 2016

DIP Contract Monitoring (DIP CM) Technology Stack BE-ICS8 02 September 2016 Webc-shuttle DIP broadcast … DIP data Create / Edit contracts Store data & Meta-data DIP Repository Monitoring

DIP Web Browser Motivation : Easy access to DIP data from anywhere Get rid of the trusted machines to run Java DIP Browser → Web browser Dependency with Java Runtime libraries and even native libraries (Windows or Linux) Reusable components Possibility to reuse the same components in other webpages simply by adding HTML tags Possibility to create and customize dashboards BE-ICS9 02 September 2016

DIP Web Browser BE-ICS September 2016 Impact Tree Filtering via external component Visualization Panels Resizable Relocatable Tables: Filtering Sorting

DIP Bridge Provide a DIP repeater across networks : From the CERN TN to the CERN GPN On the CERN TN, to provide publication aliasing (name remapping) Provide a safety fuse between TN and GPN consumers : Currently, a trusted GPN consumer can easily exhaust any publisher resources. … With a Bridge, they only impact other GPN consumers. Provide an insulation layer for web-based consumers : For the DIP Web Browser For Web data broadcasting in general. BE-ICS11 02 September 2016

DIP Bridge Based on the LHCb / CMS Dim Bridge utility : Support complex service name (=“DIP Publication”) remapping. Support multiple configuration profiles (all Bridge configured from a single place). Support for process monitoring and automatic restarts. Addition of Google Test unit testing. Multiple instances deployed to provide scalability Notes : A single-process DIM Bridge introduces a performance bottleneck and single point of failure. BE-ICS now responsible for all GPN consumers. We can mitigate impact by running multiple Bridges. BE-ICS12 02 September 2016

Project update - effort Team MemberTasksFTE Percent EleniDIP Web Browser C2MON Data Broadcast 50% 30% IvanDIP CM web editor DIP CM workflow 25% BriceDIP Bridge C2MON Data Broadcast 30% 10% BE-ICS13 02 September 2016

Project update - WBS DIP Bridge Complete multi-process Unit and Load Testing Write distributed bridge service wrapper and add monitoring DIP Web Browser Integrate new C2MON web broadcasting Depends on porting of current Broadcast to C2MON (separate project) Adopt new C2MON web broadcasting DIP CM Productize the DIP Contract Web Editor prototype Complete the MODESTI2-based workflow support Complete integration with C2MON Metadata for contract monitoring support Prepare Contract Monitoring web application (based on DIP Web Browser, with history support). Again, dependency on porting of current Broadcast to C2MON BE-ICS14 02 September 2016

Thank you, any questions ? BE-ICS15 02 September 2016 Thanks to Justin and Matthias for the great C2MON support !

Extra material BE-ICS16 02 September <iron-ajax/> <webc-gridstack/> <broadcast-datasource/> index.html JS functions DIP Web Browser Structure