Monitoring OSGi platforms with ProActive Virginie Legrand OASIS Team - INRIA Sophia Antipolis

Outline Introduction : The PISE project Introduction : The PISE project A solution for Large scale deployment of services: A solution for Large scale deployment of services: A library for remote deployment A library for remote deployment A Monitoring and Management tool A Monitoring and Management tool Technical elements : New features in ProActive Technical elements : New features in ProActive ProActive on top of OSGi ProActive on top of OSGi An extended JMX connector based on ProActive An extended JMX connector based on ProActive Conclusion and Perspectives Conclusion and Perspectives

Context : The PISE Project French gov. funded project (RNRT program) French gov. funded project (RNRT program) Project consortium Project consortium 3 French companies 3 French companies 2 French research labs 2 French research labs Develop a middleware to build and to host M2M services on industrial gateways in power distribution domain Software engineering methods and tools to develop, to deploy and administrate business services Runtime environment on the top of OSGi™ platforms Compliance with standards Flexibility Security Runtime environment on the top of OSGi™ platforms Compliance with standards Flexibility Security

Code generation Model Editor OSGi™ industrial gateway Device Service DS BS Secure Deployment Monitoring BS Alarm BS Description of an application model Functional Aspects : Device Services and Business Services Non-functional Aspects : Security, Distribution, Trace (log) Sepam Micrologic Deployment and Monitoring PISE : objectives

OSGi Gateway : Defines a framework that allows services to be loaded in a service gateway like a set top box, or an application (ex eclipse Framework, Jonas …) A sharable JVM between several applications : A sharable JVM between several applications : Shares packages Shares packages Launch / stop services Launch / stop services Dynamic deployment of services without reboot of the gateway Dynamic deployment of services without reboot of the gateway

Outline Introduction : The PISE project Introduction : The PISE project A solution for Large scale deployment of services : A solution for Large scale deployment of services : A library for remote deployment A library for remote deployment A Monitoring and Management tool A Monitoring and Management tool Technical elements : New features in ProActive Technical elements : New features in ProActive ProActive on top of OSGi ProActive on top of OSGi An extended JMX connector based on ProActive An extended JMX connector based on ProActive Conclusion and Perspectives Conclusion and Perspectives

Rationale : Large scale deployment Large scale deployment and management is a painful operation that cannot be done by hand. Large scale deployment and management is a painful operation that cannot be done by hand. Objectives: Objectives: From a deployment plan, we want to initiate applications installation on a big number of heterogeneous platforms From a deployment plan, we want to initiate applications installation on a big number of heterogeneous platforms 1 target, 10 targets, 1000, ? 1 target, 10 targets, 1000, ?

Large scale Deployment processus Create the deployment structure Create the deployment structure Gateways are grouped according precise criteria in a hierarchical set. Gateways are grouped according precise criteria in a hierarchical set. Introspect gateways in order to know their dynamic characteristics and already deployed services Introspect gateways in order to know their dynamic characteristics and already deployed services Select implementations fitting to the gateways Select implementations fitting to the gateways Resolve dependencies for selected services Resolve dependencies for selected services Install and start services on the set of gateways Install and start services on the set of gateways

A library for large scale deployment Based on ProActive Based on ProActive Asynchronous and Group communications that provide the support for scalability needs. Asynchronous and Group communications that provide the support for scalability needs. Adresses large scale deployment concerns : Adresses large scale deployment concerns : Gateways states are stored in a database: Initial state + event-based updates Gateways states are stored in a database: Initial state + event-based updates Up-to-date gateways snapshot eases the computation of deployment plans – push model. Up-to-date gateways snapshot eases the computation of deployment plans – push model. Execution of deployment plan architecture Execution of deployment plan architecture Parallel and, Parallel and, Transactional Transactional

Parallel Execution of Deployment Plans Unit deployment plan Unit deployment plan Ordered list of actions to remotely execute on the gateway to deploy an application. Ordered list of actions to remotely execute on the gateway to deploy an application. Example : Example : install install Gobal deployment plan Gobal deployment plan A set of Unit Plans corresponding to each of the gateways A set of Unit Plans corresponding to each of the gateways Can be executed in 2 modes: Can be executed in 2 modes: Broadcast Broadcast Scatter Scatter Hierarchical structure of plan executors that manage a sub- group of gateways. Hierarchical structure of plan executors that manage a sub- group of gateways. Plan Executor GlobalPlan OSGi GW

Some actions could have failed driving the gateway into an incoherent state. Some actions could have failed driving the gateway into an incoherent state. Rolls back the gateway into a stable state Rolls back the gateway into a stable state Transactional mechanism for deployment processus Allows to validate or cancel a plan execution Validation : New state declared as stable. Validation : New state declared as stable. Cancellation : The gateway unrolls the deployment plan. Cancellation : The gateway unrolls the deployment plan. Behind the scene : Concurrent execution of several transactions within the same gateway Concurrent execution of several transactions within the same gateway Transactions could be started on either a single gateway or a group of gateways Transactions could be started on either a single gateway or a group of gateways Compensation plan: generated during each other parallel execution of a plan on a same gateway : Compensation plan: generated during each other parallel execution of a plan on a same gateway : Contains the list of actions that have not been done but that should have been done. Contains the list of actions that have not been done but that should have been done. Transactional and Parallel execution

OSGi GW Transactional mode example Deployer Model Editor DS BS Code generation Plan Computation Persistant gateways states Global Plan Unit Plan VALIDATION CANCELLATION

Compensation plan OSGi GW T1 T2 T1’ T2’ CANCELLATION : T1 Compensation plan

Outline Introduction : The PISE project Introduction : The PISE project A solution for Large scale deployment of services : A solution for Large scale deployment of services : A library for remote deployment A library for remote deployment A Monitoring and Management tool A Monitoring and Management tool Technical elements : New features in ProActive Technical elements : New features in ProActive ProActive on top of OSGi ProActive on top of OSGi An extended JMX connector based on ProActive An extended JMX connector based on ProActive Conclusion and Perspectives Conclusion and Perspectives

Monitoring and Management of OSGi Gateways Monitoring tool: Monitoring tool: Gathers and Displays gateways events on the administrator‘s console: Gathers and Displays gateways events on the administrator‘s console: Allows remote access to the gateway Allows remote access to the gateway Management tool: Management tool: Manages remote applications’ lifecycle Manages remote applications’ lifecycle Correctives management tasks Correctives management tasksScalable Grouped actions

A graphical tool for large scale monitoring

Outline Introduction : The PISE project Introduction : The PISE project A solution for Large scale deployment of services : A solution for Large scale deployment of services : A library for remote deployment A library for remote deployment A Monitoring and Management tool A Monitoring and Management tool Technical elements : New features in ProActive Technical elements : New features in ProActive ProActive on top of OSGi ProActive on top of OSGi An extended JMX connector based on ProActive An extended JMX connector based on ProActive Conclusion and Perspectives Conclusion and Perspectives

ProActive on top of OSGi ProActive Bundle : ProActive Bundle : contains all classes required to launch a ProActive runtime on top of OSGi. contains all classes required to launch a ProActive runtime on top of OSGi. offers a service, the ProActiveService offers a service, the ProActiveService HTTP Communication HTTP Communication Use of the OSGi stantard HTTP service Use of the OSGi stantard HTTP service OSGi gateway HTTPService ProActive ProActive Application Active bundle ”

A ProActive JMX Connector 3 levels architecture 3 levels architecture Resources instrumentation : MBeans Resources instrumentation : MBeans MBean Server MBean Server Remote access : connectors and adaptors Remote access : connectors and adaptors == Events Notifications == Events : Connector customization : ProActive Connector: Active object ProActive Connector: Active object Extended for asynchronism Extended for asynchronism MBean Server MBean RMI Connector HTML Adaptor Instrumentation MBean PISE Agent RMI Client HTML Browser ProActiveConnector ProActive JMX Client

Outline Introduction : The PISE project Introduction : The PISE project A solution for Large scale deployment of services : A solution for Large scale deployment of services : A library for remote deployment A library for remote deployment A Monitoring and Management tool A Monitoring and Management tool Technical elements : New features in ProActive Technical elements : New features in ProActive ProActive on top of OSGi ProActive on top of OSGi An extended JMX connector based on ProActive An extended JMX connector based on ProActive Conclusion and Perspectives Conclusion and Perspectives

Conclusion and future works Complete solution for large scale deployment : Complete solution for large scale deployment : From deployment plan computation to installation, including remote gateways start up. Towards : Towards : large scale management of applications (Services4All) large scale management of applications (Services4All) An OSGi-ed version of ProActive fractal applications An OSGi-ed version of ProActive fractal applications … and an « a la carte » ProActive ! … and an « a la carte » ProActive !