CPSCG: Constructive Platform for Specialized Computing Grid Institute of High Performance Computing Department of Computer Science Tsinghua University Ming CHEN, Guangwen YANG

Advanced Grid Research Workshops through European and Asian Co-operation Outline 1.Introduction 2.Architecture 3.Applications 4.Summary

Advanced Grid Research Workshops through European and Asian Co-operation Enabling fast, straightforward construction of grid system CPSCG is not only another grid middleware, but also a lightweight and ready-to-use platform for directly deploying grid service CPSCG provides flexible system-level services to make legacy applications grid-service ready

Advanced Grid Research Workshops through European and Asian Co-operation Key Features 1.Streamline deployment 2.Support both plain web service and WSRF 3.Automate application service visualization 4.Fully distributed while maintaining single image

Advanced Grid Research Workshops through European and Asian Co-operation Design Consideration 1.Enable fast deployment of, and easy access to application services 2.Endorse domain autonomy 3.Adapt to dynamic, unreliable, unpredictable Internet loose-coupled domains, fully distributed system, best effort services

Advanced Grid Research Workshops through European and Asian Co-operation Outline 1.Introduction 2.Architecture 3.Applications 4.Summary

Advanced Grid Research Workshops through European and Asian Co-operation Overview One Platform –Information Center –Front End –Back End Two Support Tool –Encapsulation –FiTMPI

Advanced Grid Research Workshops through European and Asian Co-operation Platform: Deployment Domain Front end Back End Windows Back End Linux Information Center Linux Cluster Domain Front End Back End IA32 Back End IA64 LAN WAN/LA N Domain Front End Back End PC Back End Cluster Information Center Domain A Domain B Domain C Support Tool

Advanced Grid Research Workshops through European and Asian Co-operation Security Monitor Schedule Local User` Local User` Local Services Local Services Local Jobs Local Jobs Local Service EngineRemote Service Proxy Dynamic Service Render Remote Data Agent Remote Data Agent Local Data Management Local Data Management Back End Agent Back End Agent Back End Agent Back End Agent Service Layer Function Layer SynchronizerService List Domains List Maintainer Domains List Maintainer Information Center Platform Components Back End Local SchedulerMonitor Local SchedulerMonitor

Advanced Grid Research Workshops through European and Asian Co-operation Information Centers Maintain information of all registered services for service query Support UDDI to be compatible with Web Service Fully duplicated to be resilient to single failure Synchronize with each other using Bloom Filter to reduce network traffics and timestamp to keep consistent

Advanced Grid Research Workshops through European and Asian Co-operation Synchronization Information Center A Service List Bloom Filter Service List Digest Information Center B Exchange Digest Synchronize

Advanced Grid Research Workshops through European and Asian Co-operation Service Query Job Management Status Query Account Management Node Management Service Management Access Policy Management Domain Front End Domain Front End Back End PC Back End cluster Domain Administrator End User Application Web service/WSRF Web Pages Every front end represents a single-sign point

Advanced Grid Research Workshops through European and Asian Co-operation One-hop Routing: Improve Reliability Remote Service Proxy Local Service Engine Domain A Remote Service Proxy Intermediate Domain C Domain B

Advanced Grid Research Workshops through European and Asian Co-operation Monitor Architecture

Advanced Grid Research Workshops through European and Asian Co-operation Snapshot

Advanced Grid Research Workshops through European and Asian Co-operation Back End Deployed in computing PCs/Clusters, hidden from other domains Communicate with its CPSCG front end and execute job from front end Support MPI/PBS Can be another CPSCG front end

Advanced Grid Research Workshops through European and Asian Co-operation Overview One Platform –Information Center –Front End –Back End Two Support Tool –Encapsulation –FiTMPI

Advanced Grid Research Workshops through European and Asian Co-operation Support Tool: Legacy Applications Encapsulation Make legacy applications, especially large volume of command-line based applications, grid service ready Fast, straightforward, but flexible encapsulation

Advanced Grid Research Workshops through European and Asian Co-operation Process of Encapsulation Command-line Application Command-line Application Interpreter & Service Package Generator Interpreter & Service Package Generator GT4 Tomcat/JBoss Web Service Package WSRF Package Web Service Package WSRF Package Web Service Package Web Service Package Interactive User Input

Advanced Grid Research Workshops through European and Asian Co-operation FitMPI Heterogeneous environment Resource Monitoring Auto deployment Communication between intranets Input/Output Management Process Management

Advanced Grid Research Workshops through European and Asian Co-operation A Hello World -Like Demo Install a system Publish a back end Deploy a service (Encapsulation): PClustalW Invoke the service and get the result

Advanced Grid Research Workshops through European and Asian Co-operation Install

Advanced Grid Research Workshops through European and Asian Co-operation Publish A Back End

Advanced Grid Research Workshops through European and Asian Co-operation Deploy Service Step 1: Select An Installed Legacy Application

Advanced Grid Research Workshops through European and Asian Co-operation Deploy Service Step 2: Edit Service Interface

Advanced Grid Research Workshops through European and Asian Co-operation Deploy Service Step 2: Edit Service Interface (Cont.)

Advanced Grid Research Workshops through European and Asian Co-operation Deploy Service Step 3: Publish!

Advanced Grid Research Workshops through European and Asian Co-operation Invoke Service Step 1: Select An Intended Service Service can also be accessed via Web Service or WSRF

Advanced Grid Research Workshops through European and Asian Co-operation Invoke Service Step 2: Input Parameters

Advanced Grid Research Workshops through European and Asian Co-operation Get the Result

Advanced Grid Research Workshops through European and Asian Co-operation Analyze Result with Other Tool

Advanced Grid Research Workshops through European and Asian Co-operation Application: BioInformatic Grid Phrap Cap3 Blaster PClustalw (MPI)/Clustalw …

Advanced Grid Research Workshops through European and Asian Co-operation Summary 1.CPSCG provides a platform helping end users fast and efficiently deploy grid system and grid services 2.CPSCG Supports domain autonomy via loose- coupled architecture, while offering global single image

Thank you!