Grid Component Model and Platform: An Overview Workshop on Evolutions of GRIDs Towards SOKUs OGF20, Manchester, 8 May 2007 Vladimir Getov CoreGRID STE Institute Leader University of Westminster, London, U.K.

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 2 Wave2 – start 2006 Wave 2 – start 2006 Degree Datamining Grid data, knowledge, semantics OntoGridInteliGrid K-WF Grid Chemomen tum A-WareSorma platforms, user environments CoreGRID virtual laboratories UniGridsHPC4Ug-EclipseGrediaGridComp QosCosGrid Grid4all ProvenanceAssessGrid GridTrust trust, security Grid services, business models ArguGrid Grid GridEcon GridCoordNessi-Grid Challengers NextGRID service architecture Akogrimo mobile services BREIN agents & semantics BeinGrid business experiments supporting the Grid community SIMDAT industrial simulations XtreemOS Linux based Grid operating system BeinGrid business experiments KnowArcEC-GinBridge international cooperation Specific support action Integrated project Network of excellence Specific targeted research project Wave 1 – start 2004 EU Funding: 130 M Grid Research Projects under FP6

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 3 Preventing research fragmentation Developing world-class scientific and technological excellence Achieving sustainable integration Contributing to the realisation of the European Research Area for Grid Research Knowledge and data management Programming models System architecture Grid Information, Resource and Workflow Monitoring Resource Management & Scheduling Grid Systems, Tools and Environments Six highly-focused Research Institutes across 41 Research Labs Gathering 145 researchers & 169 PhD students into a single EU Laboratory on Grid Technologies

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 4 CoreGRID Definition of Future Grids A fully distributed, dynamically reconfigurable, scalable and autonomous infrastructure to provide location independent, pervasive, reliable, secure and efficient access to a coordinated set of services encapsulating and virtualizing resources (computing power, storage, instruments, data, etc.) in order to generate knowledge.

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 5 From Grids to SOKU Next Generation Grids Software Technologies Knowledge Technologies Service- Oriented Knowledge Utility Evolution of HPCN Current Grids SOA Methodologies Autonomic Computing Evolution of the Web … …

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 6 Background: How to build Grid Middleware Proprietary middleware (Globus 1.0, Legion, Unicore, …) –Resources exposed through an API –Non interoperable ! Object-based middleware –Resources exposed through distributed objects (Java, CORBA, etc.) –Some interoperability issues with the communication protocols (CORBA IIOP) –Not anymore at the top of the hype ! Service-based middleware –Resources exposed through services –Strong support from the Industry –At the top of the hype ! –Need some extensions (stateful Web services)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 7 One of the Main Research Challenges for Future Grids To develop the software design and development methodology of a generic component-based Grid platform for both applications and tools/systems/PSEs to have a single, seamless, invisible Grid software services infrastructure. Possible Solution: Grid Component Model (GCM): Proposal for a Grid Component Model - DPM02 Basic Features of the Grid Component Model (assessed) - DPM04 GoreGRID Institute on Programming Models

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 8 GCM: Main Features –Component hierarchy –Extensibility of the model –Support for adaptivity –Language neutrality –Interoperability –Reflexivity Lightweight portable and compact implementations Well-defined semantics (allow future formalization)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 9 GCM Technical Structure Component Specification as an XML schema Run-Time API defined in several languages C, Java, etc. Packaging described as an XML schema Information for Deployment (Virtual Nodes, … Variables, File Transfer, …)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 10 Collective Interfaces Simplify the design and configuration of component systems Expose the collective nature of interfaces –Multicast, Gathercast, gather-multicast The framework handles collective behaviour at the level of the interface Based on Fractal API : –Dedicated controller –Interface typing Verifications

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 11 Content and Main Activities: GCM Reference Implementation 1 - Primitive Component Programming 2 - Legacy Code Wrapping, Interoperability 3 - Composition and Composites, Deployment 4 – Autonomic features 5 – IDE for GCM (Composition GUI, etc.)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 12 Research Example: Componentising an Application for the Grid INRIA and University of Westminster Jem3D –numerical solver for the 3D Maxwells equations modelling the time domain propagation of electromagnetic waves –follows typical geometric decomposition parallelisation –distributed object application using ProActive ProActive library –Java distributed object middleware for parallel and concurrent programming –Main features: Active objects, Asynchronous method invocation, Group communications, Descriptor-based deployment

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 13 Research Example: Componentisation Process General, architecture-based process Object-based system Component-based system Early GCM using ProActive – extends Fractal with: distributed components multicast interfaces configurable deployment on the Grid

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 14 Research Example: Performance Evaluation Comparison: Object-based vs. Component-based –experiments on Grid5000 using up to 308 processors, allocated on up to 3 clusters –7 experiments using different problem size and number of processors –execution times of two versions are similar

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 15 Domain-Specific Metadata for Model Validation and Performance Optimisation – Legacy Applications GENIE is an interactive, legacy code for Earth system modelling. Our hypothesis is that componentising the application and using domain-specific metadata will help transforming it into a scalable yet efficient Grid system.

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 16 Domain-Specific Metadata for Model Validation and Performance Optimisation Motivation: Enable legacy applications to evolve as a part of the scalable problem solving environments within modern Grid systems. Framework: Componentising existing applications along with domain- specific metadata so that issues arising thereof can be addressed using this metadata. Result: Used GENIE (Earth Simulation System) as a motivating example. Derived different domain- and component-specific metadata and optimisation strategies. Further Work: The principles we outlined are application-specific. A generic, but domain-restricted approach is required and potential performance benefits need to be demonstrated. Partners: -University of Westminster (UK) -Imperial College - London (UK) -Ongoing work: CoreGRID TR-0068 and a chapter in a CoreGRID Springer volume

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 17 Some Future Research Goals Adoption of GCM for Grid applications development Generic, lightweight component-based Grid platform design methodology Use of GCM for Grid system software design Integration of application and system components into a single adaptable Grid platform Interoperability between peer-to-peer and client- server paradigms in hybrid Grid systems

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 18 New Spin-off Project - GridCOMP -FP6 Call5 -GridCOMP nvolves 6/12 CoreGRID partners: INRIA, ERCIM, UNIPI, UOW, ISTI/CNR, UCHILE -Main goal: develop a GCM prototype platform -Strong industrial involvement: IBM, Atos Origin, Grid Systems -Worldwide partners: Tsinghua University (China), Melbourne University (Australia), and University of Chile (Chile)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 19 Conclusions Research work ongoing in both CoreGRID and GridCOMP projects Some other CoreGRID Institutes adopting GCM More research results to be expected soon Strong interest from the US community – joint focused yearly workshop High industrial interest via the GridCOMP project ETSI interest to initiate further work on the GCM specification An OGF activity - ?