European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER) Overview of GCM (Grid Component Model) and GridCOMP EU Project Denis Caromel OASIS INRIA-UNSA-CNRS I3S Melbourne, Jan Overview of GCM (Grid Component Model) and GridCOMP EU Project Denis Caromel OASIS INRIA-UNSA-CNRS I3S Melbourne, Jan ProActive context 2. GCM

European Commission Directorate-General Information Society Unit F2 – Grid Technologies ProActive and GCM Structuring Structuring of the library of the library  3 big layers  Inner bricks Component Component Aspects: not Aspects: not only only in Cp Box! in Cp Box!

European Commission Directorate-General Information Society Unit F2 – Grid Technologies ProActive New GUIs New GUIs  IC2D Eclipse  TimIt

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Grid Computing with ProActive Melbourne Amsterdam Beijing Shanghai Hierarchical Deployment Challenges: Programming Model, Scale, Latency, Heterogeneity, Versatility (protocols,firewalls...)

European Commission Directorate-General Information Society Unit F2 – Grid Technologies A ProActive : Active objects Proxy Java Object A ag = newActive (“A”, […], VirtualNode) V v1 = ag.foo (param); V v2 = ag.bar (param);... v1.bar(); //Wait-By-Necessity V Wait-By-Necessity is a Dataflow Synchronization JVM A Active Object Future Object Request Req. Queue Thread v1 v2 ag WBN!

European Commission Directorate-General Information Society Unit F2 – Grid Technologies A Creating AO and Groups Typed Group Java or Active Object A ag = newActiveGroup (“A”, […], VirtualNode) V v = ag.foo(param);... v.bar(); //Wait-by-necessity V Group, Type, and Asynchrony are crucial for Cpt. and GRID JVM

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Objects to Distributed Components Typed Group Java or Active Object ComponentIdentity Cpt = newActiveComponent (params); A a = Cpt ….getFcInterface ("interfaceName"); V v = a.foo(param); V A Example of a component instance JVM Truly Distributed Components

European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER) GCM + Scopes and Objectives: Grid Codes that Compose and Deploy No programming, No Scripting, … No Pain Innovation: Composite Components Multicast and GatherCast MultiCast GatherCast

European Commission Directorate-General Information Society Unit F2 – Grid Technologies GCM: Grid Component Model GCM: Grid Component Model  GCM Being defined in the NoE CoreGRID (42 institutions)  Open Source ObjectWeb ProActive implements a preliminary version of GCM  Service Oriented: NESSI relation exp. GridCOMP takes: GridCOMP takes:  GCM as a first specification,  ProActive as a starting point, and Open Source reference implementation. The vision: GCM to be the GRID GSM

European Commission Directorate-General Information Society Unit F2 – Grid Technologies GridCOMP Partners

European Commission Directorate-General Information Society Unit F2 – Grid Technologies GCM Architecture

European Commission Directorate-General Information Society Unit F2 – Grid Technologies GCM Technical Structure Component Specification as an XML schema or DTD Run-Time API defined in several languages C, Java Packaging described as an XML schema Information for Deployment (Virtual Nodes, … Variables, File Transfer, …)

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Content and Activities 1 - Primitive Component Programming 1 - Primitive Component Programming 2 - Legacy Code Wrapping, Interoperability 2 - Legacy Code Wrapping, Interoperability 3 - Composition and Composites, Deployment 3 - Composition and Composites, Deployment 4 – Autonomic features 4 – Autonomic features 5 – IDE for GCM (Composition GUI, etc.) 5 – IDE for GCM (Composition GUI, etc.)

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Collective Interfaces

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Collective Interfaces Simplify the design and configuration of component systems Simplify the design and configuration of component systems Expose the collective nature of interfaces Expose the collective nature of interfaces  Cardinality attribute  Multicast, Gathercast, gather-multicast The framework handles collective behaviour The framework handles collective behaviour at the level of the interface at the level of the interface Based on Fractal API : Based on Fractal API :  Dedicated controller  Interface typing  Verifications

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Multicast interfaces Transform a single invocation into a list of invocations Multiple invocations Multiple invocations  Parallelism  Asynchronism  Dispatch Data redistribution (invocation parameters) Data redistribution (invocation parameters)  Parameterisable: Distribution Function  Broadcast, scattering  Dynamic redistribution: Dynamic dispatch Result = list of results Result = list of results

European Commission Directorate-General Information Society Unit F2 – Grid Technologies

Multicast interfaces  Results as lists of results  Invocation parameters may also be distributed from lists

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Gathercast interfaces Transform: a list of invocations   a list of invocations   a single invocation a single invocation Synchronization of incoming invocations Synchronization of incoming invocations  ~ “join” invocations  Timeout / Drop policy  Bidirectional Bindings (callers  callee) Data gathering Data gathering Aggregation of parameters into lists Result: Result: Redistribution of results Redistribution of results Redistribution function

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Status of GCM in ProActive Partial implementation: Partial implementation:  ADL schema, API, Multicast, Gathercast, …  Component GUI (prototype) Distributed components for various applications: Distributed components for various applications:  Numerical, Legacy, … On-going experiments: On-going experiments:  up to 300+ CPUs

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Current GCM experiments in ProActive JEM3D: 3D electromagnetic application: JEM3D: 3D electromagnetic application: a single Cp on 300+ CPUs on Grid Vibro-Acoustic application with EADS (legacy MPI coupling) Vibro-Acoustic application with EADS (legacy MPI coupling)

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Current GCM experiments in ProActive IBM: IBM:  Security Fingerprint System ATOS Origin: ATOS Origin:  Financial Application Optimization GridSystems: GridSystems:  Wing Simulation  Telecom Application, EDR processing

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Update on ProActive and GCM (1) New Version under preparation: New Version under preparation:  Nov. 10: ProActive Version 3.2 Beta  Jan. 26: ProActive Version 3.2 (After PlugTests’ Learning, New Web Site)  New features in 3.2 release: Next slide

European Commission Directorate-General Information Society Unit F2 – Grid Technologies New Web Site with 3.2 Version

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Chinese Web thank to Tsinghua Univ.

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Update on ProActive and GCM (2) New Features in ProActive Version 3.2: New Features in ProActive Version 3.2:  New features in 3.2 release:  Conformance tests for Fractal, towards conformance tests for GCM  IC2D Eclipse Plugin  TimIt (Hierarchical, Visual)  Skeleton (improved, with File Transfer, Documentation)  gLite EGEE deployment updated  Support for Java 1.5 Generics:  Active Objects can be instantiated from Generic Classes  Some Warnings removed  Improvements in OSGi integration  Prototype TTools for UML modeling of GCM components (TBC)

European Commission Directorate-General Information Society Unit F2 – Grid Technologies A Vision: GCM as EU’s GSM Once upon a time: Once upon a time:  GSM: Global System for Mobile communication Process: Process:  “critical decisions […] the GSM initiative became a success in Europe […]  Initially the strategy and technical specifications were agreed for Europe and […] incorporating all non-European requirements […] worldwide to participate ” From: Gsm & Umts: The Creation From: Gsm & Umts: The Creation of Global Mobile Communications of Global Mobile Communications Standardization of GSM was crucial for EU advances in Mobile Telephony (Science and Business)

European Commission Directorate-General Information Society Unit F2 – Grid Technologies A Vision: GCM as EU’s GSM GRID faces the same challenge:  Build Flexibility  Openness  InteroperabilityObjectives: Build a Word-Wide standard for Science and Business GRIDs: GCM

European Commission Directorate-General Information Society Unit F2 – Grid Technologies GSM and GCM Pictures GSM cells: GSM cells: Components: Components:

European Commission Directorate-General Information Society Unit F2 – Grid Technologies GSM and GCM Pictures

European Commission Directorate-General Information Society Unit F2 – Grid Technologies GSM and GCM Pictures

European Commission Directorate-General Information Society Unit F2 – Grid Technologies Conclusion (1) Scientific Issues and Directions Components in the membrane: Membrane: Membrane:  Meta-Objects  Java Objects Components: Components:  Active Objects If Cp in Mb: If Cp in Mb:  Active Objects as Meta-Objects  Not suited for all cases. If Dist.  AO If light+local  POJO TBD

European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER) Conclusion (2) Key technology advancements Programming the Grid with reusable, composable, components Programming the Grid with reusable, composable, components  vs. ad hoc solutions Component for Separation of Concerns and AOP: Component for Separation of Concerns and AOP:  Gathercast allows to have synchronisation outside functional code Deployment on various architectures Deployment on various architectures  Super Computer Center, Clusters, data-center, desktop Grids, … Interoperability with related Grid software Interoperability with related Grid software Integration into Service Oriented Architecture (SOA) Integration into Service Oriented Architecture (SOA)

European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER) Conclusion (3) Research Challenges A general enough GCM, still efficient A general enough GCM, still efficient Effective composition: Effective composition: Semantics, Deployment, Portability Non-Functional Aspects: Non-Functional Aspects: Security, Load-Balancing, Fault-tolerance, CP. Specif (Lotos, UML TTools, pNets) and Model Checking Verification