Model Driven Middleware: A New Approach for Developing & Provisioning Large-scale Distributed Real-time and Embedded Applications Dr. Aniruddha Gokhale Assistant Professor (EECS & ISIS) Vanderbilt University Nashville, TN Work supported by AFRL contract# F C-4112 for DARPA PCES Program

Aniruddha GokhaleMDM 2 Research Synopsis Develop, validate, & help to standardize technologies that: (1) Model (2) Analyze (3) Synthesize & (4) Provision multiple layers of middleware for distributed real-time and embedded (DRE) systems that require simultaneous control of multiple quality of service properties end-to-end Model Driven Middleware for Distributed Real-time & Embedded Systems Middleware Services DRE Applications Operating Sys & Protocols Hardware & Networks distributed system

Aniruddha GokhaleMDM 3 R&D Focus: Distributed Real-time & Embedded (DRE) Systems Network-centric & large-scale Dynamic context Stringent simultaneous quality of service (QoS) demands Part of larger systems Resource constrained Network-centric & large-scale Dynamic context Stringent simultaneous quality of service (QoS) demands Part of larger systems Resource constrained Total Ship C&C Center Total Ship Computing Environments

Aniruddha GokhaleMDM 4 The Transforming Landscape of DRE Appln Development Technology Problems DRE systems have historically tended to be: Stovepiped Proprietary Brittle & non-adaptive Expensive Vulnerable Historically, mission-critical apps were built directly atop hardware Tedious Error-prone Costly over lifecycles IOM BSE Middleware Services DRE Applications Operating Systems Hardware & Networks Middleware Services DRE Applications Operating Systems Hardware & Networks Middleware has effectively factored out many reusable mechanisms & services from what was traditionally DRE application responsibility Middleware is no longer primary DRE system performance bottleneck Uniform abstraction over h/w & OS e.g., JVM, ACE Distribution capabilities like location transparency, data marshaling e.g., CORBA, J2EE, webservices Commonly used higher level services e.g., Naming, Event Services specific to domains e.g., Bold Stroke (Avionics), AMW (telecom)

Aniruddha GokhaleMDM 5 Growing Trend: Component Middleware for DRE Applns Component middleware gaining importance (CCM, J2EE,.NET) Components encapsulate application core logic Components possess ports: Event sinks & sources Connection points e.g., receptacles Interfaces e.g., facets attributes Containers provide execution environment for components with common operating requirements Containers communicate via a middleware bus Middleware Bus Security ReplicationNotificationPersistence Container … … …

Aniruddha GokhaleMDM 6 Different Aspects in Component Middleware- based DRE Appln Provisioning & Deployment Specification & Implementation Application functionality specification, partitioning and implementation as standalone components Packaging bundling a suite of software binary modules and metadata representing application components Installation populating a repository with the packages required by the application Configuration configuring the packages with the appropriate parameters to satisfy the functional and systemic requirements of application without constraining to any physical resources Planning making appropriate deployment decisions including identifying the entities, such as CPUs, of the target environment where the packages will be deployed Preparation moving the binaries to the identified entities of the target environment Launching triggering the installed binaries and bringing the application to a ready state Adaptation Runtime reconfiguration & resource management to maintain end-to-end QoS

Aniruddha GokhaleMDM 7 Limitations and Complexities of Middleware Win2KLinuxLynxOS Solaris VxWorks CORBA Services CORBA Apps MIDDLEWARE ARCHS J2EE Services J2EE Apps.NET Services.NET Apps Middleware Services DRE Applications Operating Sys & Protocols Hardware & Networks There is a limit to how much application functionality can be factored into broadly reusable COTS middleware Middleware has become extremely complicated to use, configure, & provision statically & dynamically There are now multiple middleware technologies to choose from

Aniruddha GokhaleMDM 8 Related Work: MIC, Vanderbilt (Sztipanovits, Karsai, et al) Ptolemy, UC Berkeley (Lee et al) Cadena, KSU (John Hatcliff et al) Quality Connector, LMCO (Joe Cross et. al) Key Benefits Preserves DRE application functional & systemic QoS properties as high level models Domain-specific languages & analysis/synthesis tools transform models to customize underlying multi- layered middleware platforms Leverages & shapes standards for wider applicability Our Solution: Model-Driven Middleware for DRE Applns Middleware Bus Security ReplicationNotificationPersistence Container … … … …

Aniruddha GokhaleMDM 9 CIAO: Our Middleware for DRE Applications Event Notifications A/V Streaming Dynamic/Static Scheduling RT-CORBA CORBA Security FT-CORBA & Load Balancing Component Implementation Definition Language CCM Packaging & Deployment Time/space Optimizations

Aniruddha GokhaleMDM 10 The MDM Approach: OMG MDA-Middleware Integration 1.Configuring and deploying application services end-to-end 2.Composing components into component servers 3.Configuring application component containers 4.Synthesizing application component implementations 5.Synthesizing dynamic QoS provisioning and adaptation logic 6.Synthesizing middleware- specific configurations 7.Synthesizing middleware implementations

Aniruddha GokhaleMDM 11 Boeing Bold Stroke: Our Research Vehicle Avionics Product Line Component Model DRE system with 3,000+ domain- specific software components, 3-5 million lines of C++ code 100+ developers Mission-control software for Boeing military aircraft, e.g., F-18 E/F, Harrier, UCAV Leverages the ACE+TAO middleware Used as Avionics Open Experimental Platform (OEP) for DARPA/IXO PCES & MoBIES programs Moving towards using CIAO CCM

Aniruddha GokhaleMDM 12 Bold Stroke Architectural Elements Hardware organization ACE+TAO real-time CORBA distribution middleware Push-based event model Pull-based data model This common usage simplifies assembly complexity Application components (consumer) Application components (supplier)

Aniruddha GokhaleMDM 13 Bold Stroke Illustrative Example Basic Modal Single Process Product Scenario (2 operational modes) Determining the right assembly and deployment Determining the right assignment of priorities Determining the right concurrency strategy Adapting to changing operating conditions

Aniruddha GokhaleMDM 14 CoSMIC: Our MDM Tool Suite Applying OMG MDA to address DRE appln development & provisioning challenges w.r.t: 1.the packaging aspect 2.the configuration aspect 3.the planning aspect 4.the dynamic QoS provisioning & adaptation aspect … Container … … Our tool suite is called CoSMIC CoSMIC = Component Synthesis using Model Integrated Computing Middleware Bus Security ReplicationNotificationPersistence

Aniruddha GokhaleMDM 15 Challenge 1: Packaging Aspect Application components are bundled together into assemblies Several different assemblies tailored towards delivering different end-to- end QoS and/or using different algorithms can be part of the package e.g., Bold Stroke scenarios involve assembling & deploying hundreds of components Packages describing the components and assemblies can be scripted by using XML descriptors CONTEXT

Aniruddha GokhaleMDM 16 Challenge1: Packaging Aspect PROBLEMS (1/2) RT Event Channel Ad hoc techniques for ensuring syntactic & semantic compatibility End-to-end QoS metric assigned in ad hoc manner Ad hoc means to determine event channel support

Aniruddha GokhaleMDM 17 Challenge1: Packaging Aspect PROBLEMS (2/2) XML file in excess of 3,000 lines for medium sized scenarios Existing practices involve handcrafting the XML descriptors Modifications to the assemblies requires modifying XML file

Aniruddha GokhaleMDM 18 Challenge 1: Packaging Aspect Status: Component & Assembly Descriptor Modeling Language (CADML) developed in GME Used to model & synthesize assembly descriptor and package descriptor files for Boldstroke product scenarios SOLUTION Point of Contact: Krishnakumar Balasubramaniam Tao Lu

Aniruddha GokhaleMDM 19 Challenge 1: Packaging Aspect Next Steps Align CADML DSML with OMG’s D&C spec Improve syntactic & semantic compatibility checks Benchmarking of assemblies to assign QoS metrics Synthesize assembly descriptor metadata

Aniruddha GokhaleMDM 20 Challenge 2: Configuration Aspect CONTEXT Platform independent configuration Configuration of components & assemblies Configuration of component containers Configuration of middleware bus (i.e., ORB) Configuration of component server Configuration of event channel support

Aniruddha GokhaleMDM 21 server object management middleware Challenge 2: Configuring Container Policies Existing techniques for metadata configurations rely on ad hoc manual configurations e.g., CORBA server-side programming PROBLEMS (1/3) Determine the server object management policies Determine right buffer sizes Determine thread pool sizes; how are they shared; number of lanes and their priorities; if borrowing is enabled Determine various middleware policies for server objects e.g., security, lifetime, replication This “glue code” is traditionally handcrafted Ensure semantic compatibility among chosen configurations Determine end-to-end priority propagation model to use

Aniruddha GokhaleMDM 22 Challenge 2: Configuring RT Event Channels PROBLEMS (1/3) This “glue code” for event channel integration is traditionally handcrafted Determine priority propagation policies for events Determine the right locking strategies Determine the right strategy for event channel integration i.e., within container or within component Enable colocation optimizations PROBLEMS (2/3)

Aniruddha GokhaleMDM 23 Challenge 2: Configuring Middleware End-to-End I/O Subsystem M/W Bus SkeletonStub PROBLEMS (3/3) Determine right concurrency strategy Determine right demux strategy Determine right marshaling optimizations Determine right connection mgmt policy Configuring subset of underlying transports Highly flexible middleware tend to provide numerous configuration knobs that can be configured to deliver required systemic properties to applications Existing techniques of metadata configurations rely on ad hoc manual selection of configuration parameters

Aniruddha GokhaleMDM 24 Challenge 2: Configuration Aspect SOLUTION Developed a domain-specific modeling language for TAO/CIAO called Options Configuration Modeling Language (OCML) using GME User provides a model of desired options & their values e.g., Middleware bus resources Concurrency & connection management strategies Constraint checker flags incompatible options Synthesizes XML descriptors for middleware configuration

Aniruddha GokhaleMDM 25 Challenge 2: Configuration Aspect High priority Next Steps Extend OCML to capture application QoS requirements in a platform independent form Design model transformers to synthesize platforms- specific configuration models Design tools that will determine the right values for various platform-specific configuration parameters Point of Contact Emre Turkaye, George Edwards, Gan Deng

Aniruddha GokhaleMDM 26 Challenge 3: Planning Aspect Context Determine current resource allocations on target platforms Select the appropriate package to deploy on selected target Select appropriate target platform to deploy packages

Aniruddha GokhaleMDM 27 Challenge 3: Planning Aspect Problems distributed system How do you determine current resource allocations? How do you correlate QoS requirements of packages to resource needs How do you ensure that the selected targets will deliver required QoS

Aniruddha GokhaleMDM 28 Challenge 3: Planning Aspect Target platforms will be selected based on a priori benchmarking data obtained by running different packages on target configurations Modeling paradigms being developed to represent target platforms Modeling paradigms being developed for synthesizing appropriate benchmarking test suites On going work Point of Contact Jaiganesh Balasubramaniam,Arvind Krishna Collaboration with Dr. Swapna Gokhale, Univ of Connecticut on analysis techniques for selecting right set of assemblies for deployment that will assure end-to-end QoS

Aniruddha GokhaleMDM 29 Challenge 4: Adaptation & Resource Management Aspect CONTEXT Appln Server Static configuration Need to provide runtime QoS adaptation along functional path Made feasible using adaptive & reflective middleware e.g., BBN QuO, UIUC Quarterware, Lancaster OpenORB Global, dynamic resource management

Aniruddha GokhaleMDM 30 Challenge 4: Adaptation & Resource Management Aspect PROBLEMS Glue code depends on the adaptive/reflective middleware used Most existing middleware not designed to collect and distribute QoS metadata Need to retrofit middleware to collect and distribute desired QoS metadata Need to add instrumentation code to collect QoS metadata Instrumentation code manually handcrafted

Aniruddha GokhaleMDM 31 Challenge 4: Adaptation & Resource Management Aspect SOLUTION Middleware Models Integrated Models QoS Metadata model Program Transformation Tool Language- specific QoS aspects generator Collaboration with Dr. Jeff Gray (UAB) Middleware Applications Operating System Interceptor Endsystem Local Resource Manage- ment Infrastructure Middleware Distribution Middleware Common Services Domain-Specific Services Point of Contact Bala Natarajan, Jeff Parsons

Aniruddha GokhaleMDM 32 Middleware Applications Operating System Interceptor Endsystem Local Resource Manage- ment Infrastructure Middleware Distribution Middleware Common Services Domain-Specific Services Challenge 4: Adaptation & Resource Management Aspect Next Steps Middleware Models Integrated Models QoS Metadata model Program Transformation Tool Language- specific QoS aspects generator Domain specific modeling language for QoS metadata Domain specific modeling language for middleware models C-SAW model weaver available Develop generators Collaboration with Dr. Priya Narsimhan (CMU) on model driven middleware instrumentation for proactive fault tolerance

Aniruddha GokhaleMDM 33 Research Impact & Future Work Current progress stems from years of iteration, refinement, & successful use Year ARPAnet RPC Micro-kernels CORBA & DCOM Real-time (RT) CORBA Component Models (EJB) CORBA Component Model (CCM) RT/CCM DCE CoSMIC Future Research Directions High confidence, geographically distributed DRE systems Grid applications Large enterprise systems Focus on platform-independent models Future Research Directions High confidence, geographically distributed DRE systems Grid applications Large enterprise systems Focus on platform-independent models Model integrated middleware Shape the standards e.g., OMG’s Model Driven Architecture (MDA) Advanced MDA ACE/TAO

Aniruddha GokhaleMDM 34 Applying ACE+TAO in Mission-Critical DRE Systems OrganizationApplication Domain BoeingAircraft Mission Control Computer BAE SystemsJoint Tactical Radio System (JTRS) SAICDistributed Interactive Simulation HLA/RTI RaytheonAircraft Carrier self-defense Systems US ArmyJoint Tactical Terminal (JTT) JPL/NASASOFIA Telescope, Cassini Space Probe LMCOShipboard Resource Management Contact SystemsSurface mounted “pick-and-place” systems AT DeskAutomated Stock Trading CiscoHigh-performance network control KronesProcess Automation & QC SiemensHot Rolling Mill Control System CUSeeMeMonitor H.323 Servers

Aniruddha GokhaleMDM 35 Research Snapshot Funded Projects DARPA Program Composition of Embedded Systems (PCES) DARPA Adaptive & Reflective Middleware Systems (ARMS) ITS Warehouse Management (Siemens) Fault Tolerant CORBA (Lockheed Martin) Collaborations Dr. Douglas C. Schmidt, Vanderbilt University Dr. Jeff Gray (Univ of Alabama, Birmingham) Dr. Swapna Gokhale (Univ of Connecticut) Dr. Marina Thottan (Bell Labs) Dr. Priya Narsimhan (CMU) Dr. Sylvester Fernandez (Lockheed Martin) Spring ’04: CS292/CS396 – Special Topics Course on Model Driven Middleware

Aniruddha GokhaleMDM 36 DRE (DOC) Group Capabilities Faculty: Dr. Douglas C. Schmidt, Dr. Aniruddha Gokhale Research Engineers: Bala Natarajan, Jeff Parsons, Boris Kolpakov, Tao Lu Grad/UGrad Students: B. Krishnakumar, George Edwards, Emre Turkay, Arvind Krishna, J. Balasubramaniam, Gan Deng Patterns & Pattern Languages ACE Host Infrastructure Middleware Configurable Communication Systems Mission Critical DoD Systems Industrial Process Control Medical Imaging Systems TAO CORBA Distribution Middleware CIAO CORBA Component Middleware CoSMIC Model Driven Middleware

Aniruddha GokhaleMDM 37 Concluding Remarks Model, analyze, synthesize, and provision middleware technologies at multiple layers for distributed real-time and embedded systems that require simultaneous control of multiple quality of service properties end-to- end 1.Configure and deploy DRE applications end-to-end 2.Configure application component containers 3.Synthesize middleware-specific configurations 4.Synthesize dynamic QoS provisioning and adaptation logic 5.Benchmark provisioned system Model Driven Approach to:

Aniruddha GokhaleMDM 38 Downloading the Middleware & Tools Beta and Stable release can be accessed from

Aniruddha GokhaleMDM 39 EXTRA