1. Integration of Multidiscipline Applications in Grid-computing Environments NGUYEN G.T., J. BLACHON, C. PLUMEJEAUD PARA’02, Espoo, June 16th, 2002 « OPALE » PROJECT Conference on Applied Parallel Computing

2. Topics Located Sophia-Antipolis & Grenoble Follow up SINUS project New INRIA project since January 1st, 2002 OPALE NUMERIC OPTIMISATION (genetic, hybrid, …) MODEL REDUCTION (hierarchic, multi-grids, …) INTEGRATION PLATFORMS Coupling, distribution, parallelism, grids, clusters,... APPLICATIONS : aerospace, electromagnetics, …

3. APPLICATION DEVELOPER ’S POINT OF VIEW SOFTWARE ENGINEERING POINT OF VIEW USER POINT OF VIEW CONCLUSIONS OVERVIEW THEORETICAL POINT OF VIEW

4. DEVELOPER ’S POINT OF VIEW SOFTWARE ENGINEERING POINT OF VIEW USER POINT OF VIEW CONCLUSIONS OVERVIEW THEORETICAL POINT OF VIEW

5. WHERE WE ARE TODAY 1980 : one year CPU time 1992 : one month « » 1997 : four days « » 2002 : one hour « » ASCI White (LLNL) : 8192 IBM SP procs ASCI Red (Sandia) : 9632 Intel procs ASCI Blue Mountain (LANL) : 6144 SGI procs Bits and pieces….

6. TEST CASE WING PROFILE OPTIMISATION

7. TEST CASE SHOCK-WAVE INDUCED DRAG REDUCTION WING PROFILE OPTIMISATION (RAE2822) Euler eqns (0,84 Mach, i = 2°) + BCGA (100 gen.) 2D MESH : 14747 nodes, 29054 triangles 4.5 hours CPU time (SUN Micro SPARC 5, Solaris 2.5) 2.5 minutes CPU time (PC cluster 40 bi-procs PIII, Linux)

8. “CAST” INTEGRATION PLATFORM GOALS TEST CASES IMPLEMENTATION “DECISION” CORBA INTEGRATION PLATFORM DESIGN FUTURE HPCN OPTIMISATION PLATFORMS COLLABORATIVE MULTI-DISCIPLINE OPTIMISATION GENETIC & PARALLEL OPTIMISATION ALGORITHMS CODE COUPLING FOR CFD, CSM SOLVERS & OPTIMISERS C OLLABORATIVE A PPLICATIONS S PECIFICATION T OOL

9. The front stage….

10. CAST DISTRIBUTED INTEGRATION PLATFORM User interface

11. DEVELOPER ’S POINT OF VIEW SOFTWARE ENGINEERING POINT OF VIEW USER POINT OF VIEW CONCLUSIONS OVERVIEW THEORETICAL POINT OF VIEW

12. DISTRIBUTED : LAN, WAN, HSN... CODE-COUPLING FOR HETEROGENEOUS SOFTWARE COLLABORATIVE APPLICATIONS COMMON DEFINITION, CONFIGURATION, DEPLOYMENT, EXECUTION & MONITORING ENVIRONMENTS TARGET HARDWARE : NOW, COW, PC-clusters, grids,... TARGET APPLICATIONS : multidiscipline engineering,... INTEGRATION PLATFORMS Distributed tasks interacting dynamically in controlled and formally provable way What they are...

13. DISTRIBUTED SIMULATION MULTI-DISCIPLINE PROBLEM SOLVING ENVIRONMENTS HIGH-PERFORMANCE & TRANSPARENT DISTRIBUTION USING CURRENT COMMUNICATION STANDARDS USING CURRENT PROGRAMMING STANDARDS WEB LEVEL USER INTERFACES OPTIMIZED LOAD BALANCING & COMMUNICATION FLOW What is required...

14. DESIGN ALTERNATIVES HARWARE & SOFTWARE ENVIRONMENTS EXISTING PLATFORMS LEGACY APPLICATION SOFTWARE PROBLEM REQUIREMENTS Optimize specific pbs & solutions : ReMAP System evolution & development : PARIS Globus, Condor, NetSOLVE, Legion, …. How to integrate them into new PSE ?

15. INRIA PROJECTS ALTERNATIVES HARWARE & SOFTWARE ENVIRONMENTS OTHER EXISTING PLATFORMS LEGACY & NEW APPLICATION SOFTWARE PROBLEM REQUIREMENTS Optimize specific pbs : ReMAP, ATHAPASCAN System development : PARIS, OASIS Globus, Condor, NetSOLVE, Legion, …. How to integrate them into new PSE ?

16. VISUAL PROGRAMMING COMPONENTS PROGRAMMING OBJECT-ORIENTED TECHNOLOGY ADVANCES IN SOFTWARE PROGRAMMING : C++, JAVA, C#,... APPLICATION MODELING : UML REUSABILITY MODULARITY INTEROPERABILITY

17. DISTRIBUTED OBJECT ARCHITECTURE TRANSPARENT DISTRIBUTED OBJECT COMPUTING CORBA COMPLIANT SIMPLE SOFTWARE MODEL COMPONENTS PLUG-IN (e.g., optimizers, solvers) - COMPONENTS - CONNECTORS

18. DISTRIBUTED OBJECTS ARCHITECTURE SOFTWARE COMPONENTS COMPONENTS ARE DISTRIBUTED OBJECTS WRAPPERS AUTOMATICALLY (?) GENERATED COMPONENTS ENCAPSULATE CODES DISTRIBUTED PLUG & PLAY

19. CAST PROTOTYPE CAST OPTIMIZERS CORBA SOLVERS ServerWrapper Modules

20. SOFTWARE COMPONENTS BUSINESS COMPONENTS LEGACY SOFTWARE OBJECT-ORIENTED COMPONENTS DISTRIBUTED OBJECTS COMPONENTS METACOMPUTING COMPONENTS ? C++, PACKAGES,... Java RMI, EJB, CCM,...

21. DISTRIBUTED OBJECT ARCHITECTURE SOFTWARE CONNECTORS CONNECTORS ARE SYNCHRONISATION CHANNELS SEVERAL PROTOCOLS CONNECTORS = DATA COMMUNICATION CHANNELS - SYNCHRONOUS METHOD INVOCATION - ASYNCHRONOUS EVENT BROADCAST COMPONENTS COMMUNICATE THROUGH SOFTWARE CONNECTORS

22. APPLICATION DEVELOPER POINT OF VIEW SOFTWARE ENGINEERING POINT OF VIEW USER POINT OF VIEW CONCLUSIONS OVERVIEW THEORETICAL POINT OF VIEW

23. SUPPORT FOR NEW APPROACHES // SOFTWARE LIBRARIES : MPI, PVM, SciLab //,... PARALLEL and/or DISTRIBUTED HARDWARE SUPPORT SEVERAL DEGREES PARALLELISM PARALLEL APPLICATIONS DOMAIN DECOMPOSITION GENETIC ALGORITHMS GAME THEORY HIERARCHIC MULTI-GRIDS The good news….

24. Lays the ground for GRID and METACOMPUTING PC & Multiprocs CLUSTERS : thousands GHz procs... HIGH-SPEED NETWORKS : ATM, FIBER OPTICS... ADVANCES IN HARDWARE GLOBUS, LEGION CONDOR, NETSOLVE Gigabits/sec networks available (2.5, 10, …) The best news….

25. CLUSTER COMPUTING PC-cluster at INRIA Rhône-Alpes (216 Linux Pentium III procs.)

26. CLUSTER COMPUTING PC-cluster at INRIA Rhône-Alpes (216 Pentium III procs.)

27. AIRFOIL OPTIMISATION

29. The results...

30. CLUSTER COMPUTING PC-cluster at INRIA Rhône-Alpes Multi-airfoil optimization : game theory + multi-grids hierarchic algo.

31. CAST DISTRIBUTED INTEGRATION PLATFORM NICE RENNES GRENOBLE PC cluster n CFD solvers CAST GA optimiser PC cluster software VTHD Gbits/s network GRID computing... July 2001...

32. Check for syntaxe of request NSD CORBA Event channell, i1, i2, i3, …. IRD Algogen.idl AlgoGen i1,i2, i3, …, in CAST CfdSolver cfd1 CfdSolver cfd2 CAST DISTRIBUTED INTEGRATION PLATFORM Behind the stage, again...

33. Event channel, i 1, i 2, i 3, …, i n CfdSolver Cfd1 Processor P0 Processor P1 Processor P3 Processor P2 i1i1 CfdSolver Cfd2 Processor P0 Processor P1 Processor P3 Processor P2 i2i2 CfdSolver Cfd3 Processor P0 Processor P1 Processor P3 Processor P2 i3i3 Genetic Algorithm i 1, i 2,i 3, …, i n Parallelized with MPI on p processors Genetic algorithm based on selection, mutation, crossover CORBA server implemented in C++ CORBA client implemented in C++ THREE LEVELS of PARALLELISM

34. * Curves quasi-parallels => same speed up, whatever the place. * Join an horizontal asymptote: time = 200 s CAST DISTRIBUTED INTEGRATION PLATFORM The game : load balancing,...

35. DEVELOPER ’S POINT OF VIEW SOFTWARE ENGINEERING POINT OF VIEW USER POINT OF VIEW CONCLUSIONS OVERVIEW THEORETICAL POINT OF VIEW

36. BCGAFUN END InitBHYBRID PROCESS FORMULAE MILNER ’S SCCS PROCESS ALGEBRA InitH

37. OPERATORS SYNCHRONIZATION PARALLEL EXECUTION SERIAL EXECUTION ITERATIONS COMPLEX EXPRESSIONS : process formulae CHOICE IC simulation : several coupled models

38. STRONG POINTS STRONG THEORETICAL FOUNDATIONS SPECIFICATION & VERIFICATION OF COMPLEX APPS Process algebra for asynchronous systems FORMAL SPECIFICATION SYSTEM EASY TO USE Intuitive interface : simple component model No theoretical background knowledge required Transparent distribution using CORBA Milner ’s SCCS algebra

39. DEVELOPER ’S POINT OF VIEW SOFTWARE ENGINEERING POINT OF VIEW USER POINT OF VIEW CONCLUSIONS OVERVIEW THEORETICAL POINT OF VIEW

40. GRID COMPUTING DISTRIBUTED INTEGRATION PLATFORMS MULTIDISCIPLINE SIMULATION TODAY ’S FUTURE e.g., DIGITAL DYNAMIC AIRCRAFT CAST, JACO3, CCAT, ProACTIVE... GLOBUS, LEGION, CONDOR,...

41. DYNAMIC LOAD BALANCING & RESSOURCE ALLOC « COTS » PROGRAMMING METACOMPUTING TOMORROW’S FUTURE COMPONENTS OFF THE SHELF POWER SUPPLY PARADIGM APPLIED TO COMPUTING RESOURCES WORLDWIDE Behind the stage, again... OBSERVE, START, SUSPEND, RESUME, STOP, MIGRATE REMOTE PROCESSES DYNAMICALLY

42. CONCLUSION INTEGRATION PLATFORMS PROVIDE GRID COMPUTING FULLY CORBA COMPLIANT ALSO ALLOWS CORBA & non-CORBA COMPONENTS SMOOTH TRANSITION FROM EXISTING CODE-COUPLING ENVIRONMENTS DEFINE, CONFIGURE, DEPLOY, EXECUTE & MONITOR COLLABORATIVE APPLICATIONS ALLOWS SEQUENTIAL & PARALLEL COMPONENTS

43. DOCUMENTATION http://www.inrialpes.fr/opale Toan.Nguyen@inrialpes.fr http://cast.sourceforge.net/manuel