1. Grid Technologies Research and Development Ian Foster Argonne National Laboratory The University of Chicago

2. ARGONNE  CHICAGO Ian Foster Credits l Globus project Co-PI: Carl Kesselman, USC l Globus resarchers and developers at ANL, USC/ISI, NCSA, and elsewhere u Steve Tuecke, Randy Butler, Steve Fitzgerald, Brian Toonen, Gregor von Laszewski, and many others l Research supported by DARPA, DOE, NSF, NASA; equipment from Cisco Systems

3. ARGONNE  CHICAGO Ian Foster Grid Services Architecture: An Emerging Grid Computing Framework Archives, networks, computers, display devices, etc.; associated local services Protocols, authentication, policy, resource management, instrumentation, discovery, etc., etc. Grid Fabric Grid Services Appln Toolkits Applns... … a rich variety of applications... Remote viz toolkit Remote comp. toolkit Remote data toolkit Remote sensors toolkit Async. collab. toolkit

4. ARGONNE  CHICAGO Ian Foster Overview l Why Grid Services? l Review of existing Grid services u Security u Information/directory u Resource management u Data access l Our current research focus areas Grid Forum and -Grid project

5. ARGONNE  CHICAGO Ian Foster Creating a Usable Grid : Grid Services (“Middleware”) l Standard grid services that u Provide uniform, high-level access to a wide range of resources (including networks) u Address interdomain issues of security, policy, etc. u Permit application-level management and monitoring of end-to-end performance l Middleware-level and higher-level APIs and tools targeted at application programmers u Map between application and Grid

6. ARGONNE  CHICAGO Ian Foster The Challenge of Heterogeneity l Group u Institutions, people; policies l Resources u Hardware: computers, archives, networks,... l Interface u Software, mechanisms l Distance u Local, campus, metropolitan, wide area l Scale u Single CPU, cluster, supercomputer,...

7. ARGONNE  CHICAGO Ian Foster Grid Services Approach l Define and deploy standard Grid services that encapsulate heterogeneity u Simple: Cost of joining Grid is low u Noncoercive: Sites retain local control u Uniform: Cost of using Grid is low l Use a Grid information service to represent structure and status of Grid elements u Resource discovery u Application configuration and optimization l Build Grid-enabled tools to enable applications

8. ARGONNE  CHICAGO Ian Foster Grid Services l Security: authentication, authorization l Information: publication, delivery l Resource management: reservation, allocation, monitoring, control l Data: data access, replica management, metadata access l + fault detection, executable management, accounting, others

9. ARGONNE  CHICAGO Ian Foster Grid Services (1): Grid Security Infrastructure l Define uniform authentication and authorization mechanisms that allow cooperating sites to accept credentials while retaining local control l Benefit: Only one A/A infrastructure needs to be maintained at each site; enables inter- site resource sharing & interoperability l Requires u Authentication/authorization standards u Certification authority policies

10. ARGONNE  CHICAGO Ian Foster Authentication l “Grid Security Infrastructure” u Single sign-on via global credential, PKI mechanisms, mapping to local credentials u Delegation u No plaintext passwords u Retains local control over policy l Deployed across PACI and NASA sites l GSS-API binding, used by ssh, SecureCRT, gsiftp, Globus, Condor, others l GAA (Generic Authorization & Access Control) interface provides hooks for policy

11. ARGONNE  CHICAGO Ian Foster Security Architecture User Proxy CpCp Host User Protocol 1: user proxy creation Protocol 2: resource allocation Protocol 3: Resource allocation from a process Site 2 Resource Proxy global-to-local mapping table Local Policy and Mechanisms Process C rp Process CpCp Site 1 Resource Proxy global-to-local mapping table Local Policy and Mechanisms Process C rp Process CpCp C rp

12. ARGONNE  CHICAGO Ian Foster Grid Services (2): Grid Information Service l Effective resource use predicated on knowledge of system components u Publish structure and state info, dynamic performance info, software info, etc., etc. l Selection and scheduling of resources u Resource discovery: “find me an X with property Y available at time T” u Auto-configuration: “tell me what I need to know to use A efficiently/securely/...” l Gateways to other data sources required

13. ARGONNE  CHICAGO Ian Foster Information Services Technical Approaches l Infrastructure based on common protocols u LDAP as unifying communication protocol u Gateways to alternative information sources and organization l Research questions include u Unifying metadata representation u How to support range of access modes u Scalability of collection and publication methods u Index methods and discovery

14. ARGONNE  CHICAGO Ian Foster NCSA Distributed Information Services Referral Server Root Servers Organization Servers NPACI NCSAU.Tenn DOE NASA NCSA ISI mds.globus.org:389 Replicated servers Index Server(s) Remos SNMP NWS

15. ARGONNE  CHICAGO Ian Foster

16. ARGONNE  CHICAGO Ian Foster Grid Services (3): Resource Management l Issues include: u Locating and selecting resources u Allocating resources u Authentication, process creation u Other activities required to prepare a resource for use; monitoring, control u End-to-end management/co-allocation u Diverse resources: CPU, disk, network u Reservation

17. ARGONNE  CHICAGO Ian Foster Resource Management Services l Globus Resource Allocation Manager (GRAM) u Uniform interface to resource management u Integration with security, policy l Co-allocation services u Coordinated allocation across multiple resources l Globus Arch. for Reservation and Allocation u Network and CPU quality of service u Immediate and advance reservations l Resource brokers: e.g., Condor

18. ARGONNE  CHICAGO Ian Foster Resource Management Architecture “10 GFlops, EOS data, 20 Mb/sec -- for 20 mins” Metacomputing Directory Service GRAM Resource Broker Info service: location + selection Globus Resource Allocation Managers GRAM Fork LSF EASYLL Condor etc. “What computers?” “What speed?” “When available?” “50 processors + storage from 10:20 to 10:40 pm” “20 Mb/sec”

19. ARGONNE  CHICAGO Ian Foster Globus Security Infrastructure Job Manager GRAM client API calls to request resource allocation and process creation. MDS client API calls to locate resources Authentication Query current status of resource Create RSL Library Parse Update MDS with resource state information Request Allocate & create processes Process Monitor & control Site boundary GRAM ClientMDS Gatekeeper GramReporter Local Resource Manager Local Resource Management

20. ARGONNE  CHICAGO Ian Foster l Provide end-to-end Quality of Service to applications. This requires: u Discovery and selection of resources u Allocation of resources u Advance reservation of resources Supercomputer Workstation Supercomputer Workstation Advanced Resource Management

21. ARGONNE  CHICAGO Ian Foster GARA and Differentiated Services Server Diffserv Resource Manager Client GARA API Diffserv Resource Manager

22. ARGONNE  CHICAGO Ian Foster Scheduling Bulk Transfer and High-Priority Transfers

23. ARGONNE  CHICAGO Ian Foster Integrated Policy Management l Required to control reservation and scheduling l Determine who can to what to whom u Integral part of resource management l Resource  application, application  resource l Next step after authentication l Need to integrate with and augment existing approaches u Access control lists, capabilities, usage certificates

24. ARGONNE  CHICAGO Ian Foster Policy: Technical Approaches l Single API to alternative mechanisms u Similar to security infrastructure u Integration with Globus security model and Globus resource management components u Basic policy mechanism in current system l Research questions u Reusable policy structures for resource specification/management u Policy aware resource discovery/scheduling

25. ARGONNE  CHICAGO Ian Foster Grid Services (4): Storage and I/O Services l Access to remote data (GASS) u Uniform access to diverse storage management systems u Cache management u High-speed, secure transport: gsiftp u Integration with metadata & storage systems l Communication (Nexus, GlobusIO) u Application-level interfaces to comm services u Multiple methods: reliable/unreliable, IP/other, unicast/multicast u Quality of service interfaces

26. ARGONNE  CHICAGO Ian Foster

27. ARGONNE  CHICAGO Ian Foster Current Technology Focus Areas l Advanced resource management techniques u GARA: Globus Arch. for Resv. & Allocation l High-end data-intensive applications u “Data Grid” l Interfaces to commodity technologies u CoG Kit: Commodity Grid Toolkits l Distance visualization u NOVA: Network Optimized Visualization Arch. With supporting work on info/instr., policy, accounting, authentication/authorization, etc.

28. ARGONNE  CHICAGO Ian Foster The Grid Forum http://www.gridforum.org l IETF-like community forum for discussion & definition of Grid infrastructure l First two meetings (June 16-18, Oct 18-20) attracted 150 people l 9 working groups established in security, information infrastructure, resource management, accounting, etc. l Next mtg: San Diego March 22-24 2000 l See also European Grid Forum u www.egrid.org

29. ARGONNE  CHICAGO Ian Foster -Grid (“Broadband Experimental Terascale Access”) l A proposal to NSF to plan (& build) a national infrastructure for computer systems research u dedicated to research u of a scale that permits realistic experimentation u of a scale that encourages participation by adventurous applications groups u a place for computer and application scientists to tackle problems together l Initial plan is for O(20) Linux clusters, each with O(30) nodes, O(2 TB) disk, Gb/s network http://dsl.cs.uchicago.edu/beta

30. ARGONNE  CHICAGO Ian Foster Summary: Where We Are l Solid technology base for security, resource management, information services l Globus v1.1 completed, with all core services complete, robust, and documented l Many tool projects are leveraging this considerable investment in infrastructure l Substantial deployment activities and application experiments l New R&D in commodity grids, resource management, distance viz, data grids http://www.globus.org

31. ARGONNE  CHICAGO Ian Foster tomographic reconstruction real-time collection wide-area dissemination desktop & VR clients with shared controls Advanced Photon Source Case Study 1: Online Instrumentation archival storage DOE X-ray source grand challenge: ANL, USC/ISI, NIST, U.Chicago

32. ARGONNE  CHICAGO Ian Foster Case Study 2: Distributed Supercomputing SF-Express Distributed Interactive Simulation: Caltech, USC/ISI l Starting point: SF-Express parallel simulation code l Globus mechanisms for u Resource allocation u Distributed startup u I/O and configuration u Fault detection l 100K vehicles (2002 goal) using 13 computers, 1386 nodes, 9 sites NCSA Origin Caltech Exemplar CEWES SP Maui SP

33. ARGONNE  CHICAGO Ian Foster OVERFLOW with latency-tolerant algorithms MPICH-G “Grid-enabled” message passing Globus services SecurityDirectoryScheduling Process mgmtCommunication ARC SGI O2000 (California) Argonne SGI O2000 (Illinois) OVERFLOW simulation: NASA Ames

34. ARGONNE  CHICAGO Ian Foster Case Study 3: Collaborative Engineering CAVERNsoft: UIC Electronic Visualization Laboratory l Manipulate shared virtual space, with u Simulation components u Multiple flows: Control, Text, Video, Audio, Database, Simulation, Tracking, Haptics, Rendering l Uses Globus comms: (un)reliable uni/multicast l Future: Security, QoS, allocation, reservation

35. ARGONNE  CHICAGO Ian Foster Case Study 4: High-Throughput Computing Nimrod-G: Monash University Cost Deadline Available Machines l Schedule many independent tasks (e.g., parameter study) l Uses Globus security, discovery, data access, scheduling l Future: Reservation, accounting, code management, etc.

36. ARGONNE  CHICAGO Ian Foster l Problem solving environment for comp. chemistry l Globus services used for authentication, remote job submission, monitoring, and control l Future: distributed data archive, resource discovery, charging Case Study 5: Problem Solving Environment ECCE’: Pacific Northwest National Laboratory