ChinaGrid Experience with GT4 Hai Jin Huazhong University of Science and Technology

2 2 Outline Overview of ChinaGrid Experiences with GT4  Highly Available Dynamic Infrastructure  Execution Management  Data Management and Transferring  Security Future Works

3 3 ChinaGrid First phase from 2003 to key universities as initiative, 20 key universities now 15 Tflop/s computing power 150TB storage Run 5 domain-specific application grids Supported by CGSP

4 4 Layered Infrastructure of ChinaGrid High performance computing environment (campus grid) ChinaGrid Supporting Platform (CGSP) NUDT THU HUST ZSU PKU SJTU XJTU NEU SCUT BUAA SEU SDU Remote education grid Image processing grid Fluid dynamics grid Massive information processing grid Bioinformatics grid

5 5 CGSP Architecture

6 6 CGSP Overview

7 7 GSI WS-Security CAS SimpleCA Data Management Security WS Core Resource Management Information Services Authz Framework RFT RLS OGSI-DAI New GridFTP XIO JAVA WS Core (WSRF) C WS Core (WSRF) MDS2 WS-Index Pre-WS GRAM WS-GRAM CSF (contribution) pyGlobus (contributed) Python Bindings (contributed) Data Center (CGSP) Data Center (CGSP) Portal SDK (CGSP) Portal SDK (CGSP) Programming Toolkits (CGSP) Programming Toolkits (CGSP) Resource-Index (CGSP) Resource-Index (CGSP) HyperService (CGSP) HyperService (CGSP) Proxy (CGSP) Proxy (CGSP) MetaData-Man (CGSP) MetaData-Man (CGSP) InterDomain (CGSP) InterDomain (CGSP) Topologic (CGSP) Topologic (CGSP) RemoteDeploy (CGSP) RemoteDeploy (CGSP) Job Manager (CGSP) Job Manager (CGSP) WorkFlow (CGSP) WorkFlow (CGSP) HotDeploy (CGSP) HotDeploy (CGSP) GT3.9 and CGSP 1.0

8 8

9 9 Goals of Cooperation ChinaGrid contributions to global grid community Keep the advanced feature of ChinaGrid Improve the interoperability widely for whole grid community

10

11 Experience with GT4: HAND HAND: Highly Available dyNamic Deployment Infrastructure  ChinaGrid and Globus started sharing ideas and codes from June 2005  Hot deploy branch now almost ready for release CGSP 2.0 release candidates also import certain features from Globus

12 HAND (1) Container-Level DeploymentService-Level Deployment

13 HAND (2) Container level deployment advantages  Clear workflow Service level deployment advantages  Flexible management

14 HAND (3) More approaches to deploy Better Performance (against Tomcat)

15 HAND (4) Achievement  A release candidate for GT 4.2  A co-authored paper submitted to HPDC ’ 06  A excellent cooperation and communication channel  Win-win experience on international cooperation

16 CGSP Container

17 Experience with GT4: Execution Management Early experience to enhance the BPEL (ActiveBPEL) to WSRF-compatible Support for JSDL specification Support multiple schedule in a common framework  WSRF compatible Web service  Hyper Services (Virtual Service)  Composite Services  Legacy application encapsulated in GRS

18 Submission Job Submitter Job Submitter Monitor Control Workflow Deployment Workflow Deployment Job Manager Job Manager Job Executors Job Executors JMI Workflow Agent Workflow Agent Job Queue Job Queue Monitor/Control Agent Monitor/Control Agent Inter-domain Agent Inter-domain Agent Workflow Manager Execution Engine Load Balancer Database State Database State Database BPEL Engine BPEL Engine BPEL Engine BPEL Engine BPEL Engine BPEL Engine General Service Invoker General Service Invoker Workflow Invoker Workflow Invoker JSDL Parser and GRS Invoker JSDL Parser and GRS Invoker CGSP Service Container CGSP Service Container GT4.0.x Java WS Core GT4.0.x Java WS Core CGSP GRS Container CGSP GRS Container Apache Axis1.2.x Container Apache Axis1.2.x Container Execution Management (2)

19 Experience with GT4: Data Management & Transferring CGSP Data Management heterogeneous data intensive limited storage mass widely distributed distributed education mass storage research low access latency collaboration other applications Storage Resource Applications Users

20 Data Management & Transferring (2) Application-level Striped Transfer  Based on GridFTP protocol  Striping algorithm and slice & replica selection algorithm  Parallel transfer Graphical User Interfaces  A common graphical transfer client which can serve as: A GridFTP Client A CGSP Transfer Client  A user-level file system viewable through Windows Explorer Remote I/O Dragging and Dropping ….

21 Experience with GT4: Security GT GSI is composed of a set of command-line tools to manage certificates, and a set of Java classes to easily integrate security into our web services. GSI offers programmers the following features  Transport-level and message-level security  Authentication through X.509 digital certificates  Several authorization schemes  Credential delegation and single sign-on  Different levels of security: container, service, and resource CGSP User certificate at Portal level  Username-passwd & Credential (pkcs12)  Sys-service & Gen-service Job is executed by cgsp-module with user info  including username,group and domain info) Job security is guaranteed by message-level security Support the composite job security  cgsp-ac-config.xml Support dynamic security resource properties  SecurityContextService  SecurityTokenCenter  FeedbackService

22 Future Works High dynamicity and autonomy containers  CDDLM, WSDM, WS-ReliableMessage Complicated deployment policies and infrastructure  WS-Agreement, BPEL4Deployment ActiveBPEL engine running on GT4 Interoperable middleware or agents  GRS and GRAM  Information Center and MDS4  Security

23 Thanks! Hai Jin Huazhong University of Science and Technology Wuhan, , China