Grid Technologies Research and Development Ian Foster Argonne National Laboratory The University of Chicago

ARGONNE  CHICAGO Ian Foster Credits l Globus project Co-PI: Carl Kesselman, USC l Globus resarchers and developers at ANL, USC/ISI, NCSA, and elsewhere u Steve Tuecke, Randy Butler, Steve Fitzgerald, Brian Toonen, Gregor von Laszewski, and many others l Research supported by DARPA, DOE, NSF, NASA; equipment from Cisco Systems

ARGONNE  CHICAGO Ian Foster Grid Services Architecture: An Emerging Grid Computing Framework Archives, networks, computers, display devices, etc.; associated local services Protocols, authentication, policy, resource management, instrumentation, discovery, etc., etc. Grid Fabric Grid Services Appln Toolkits Applns... … a rich variety of applications... Remote viz toolkit Remote comp. toolkit Remote data toolkit Remote sensors toolkit Async. collab. toolkit

ARGONNE  CHICAGO Ian Foster Overview l Why Grid Services? l Review of existing Grid services u Security u Information/directory u Resource management u Data access l Our current research focus areas Grid Forum and -Grid project

ARGONNE  CHICAGO Ian Foster Creating a Usable Grid : Grid Services (“Middleware”) l Standard grid services that u Provide uniform, high-level access to a wide range of resources (including networks) u Address interdomain issues of security, policy, etc. u Permit application-level management and monitoring of end-to-end performance l Middleware-level and higher-level APIs and tools targeted at application programmers u Map between application and Grid

ARGONNE  CHICAGO Ian Foster The Challenge of Heterogeneity l Group u Institutions, people; policies l Resources u Hardware: computers, archives, networks,... l Interface u Software, mechanisms l Distance u Local, campus, metropolitan, wide area l Scale u Single CPU, cluster, supercomputer,...

ARGONNE  CHICAGO Ian Foster Grid Services Approach l Define and deploy standard Grid services that encapsulate heterogeneity u Simple: Cost of joining Grid is low u Noncoercive: Sites retain local control u Uniform: Cost of using Grid is low l Use a Grid information service to represent structure and status of Grid elements u Resource discovery u Application configuration and optimization l Build Grid-enabled tools to enable applications

ARGONNE  CHICAGO Ian Foster Grid Services l Security: authentication, authorization l Information: publication, delivery l Resource management: reservation, allocation, monitoring, control l Data: data access, replica management, metadata access l + fault detection, executable management, accounting, others

ARGONNE  CHICAGO Ian Foster Grid Services (1): Grid Security Infrastructure l Define uniform authentication and authorization mechanisms that allow cooperating sites to accept credentials while retaining local control l Benefit: Only one A/A infrastructure needs to be maintained at each site; enables inter- site resource sharing & interoperability l Requires u Authentication/authorization standards u Certification authority policies

ARGONNE  CHICAGO Ian Foster Authentication l “Grid Security Infrastructure” u Single sign-on via global credential, PKI mechanisms, mapping to local credentials u Delegation u No plaintext passwords u Retains local control over policy l Deployed across PACI and NASA sites l GSS-API binding, used by ssh, SecureCRT, gsiftp, Globus, Condor, others l GAA (Generic Authorization & Access Control) interface provides hooks for policy

ARGONNE  CHICAGO Ian Foster Security Architecture User Proxy CpCp Host User Protocol 1: user proxy creation Protocol 2: resource allocation Protocol 3: Resource allocation from a process Site 2 Resource Proxy global-to-local mapping table Local Policy and Mechanisms Process C rp Process CpCp Site 1 Resource Proxy global-to-local mapping table Local Policy and Mechanisms Process C rp Process CpCp C rp

ARGONNE  CHICAGO Ian Foster Grid Services (2): Grid Information Service l Effective resource use predicated on knowledge of system components u Publish structure and state info, dynamic performance info, software info, etc., etc. l Selection and scheduling of resources u Resource discovery: “find me an X with property Y available at time T” u Auto-configuration: “tell me what I need to know to use A efficiently/securely/...” l Gateways to other data sources required

ARGONNE  CHICAGO Ian Foster Information Services Technical Approaches l Infrastructure based on common protocols u LDAP as unifying communication protocol u Gateways to alternative information sources and organization l Research questions include u Unifying metadata representation u How to support range of access modes u Scalability of collection and publication methods u Index methods and discovery

ARGONNE  CHICAGO Ian Foster NCSA Distributed Information Services Referral Server Root Servers Organization Servers NPACI NCSAU.Tenn DOE NASA NCSA ISI mds.globus.org:389 Replicated servers Index Server(s) Remos SNMP NWS

ARGONNE  CHICAGO Ian Foster

ARGONNE  CHICAGO Ian Foster Grid Services (3): Resource Management l Issues include: u Locating and selecting resources u Allocating resources u Authentication, process creation u Other activities required to prepare a resource for use; monitoring, control u End-to-end management/co-allocation u Diverse resources: CPU, disk, network u Reservation

ARGONNE  CHICAGO Ian Foster Resource Management Services l Globus Resource Allocation Manager (GRAM) u Uniform interface to resource management u Integration with security, policy l Co-allocation services u Coordinated allocation across multiple resources l Globus Arch. for Reservation and Allocation u Network and CPU quality of service u Immediate and advance reservations l Resource brokers: e.g., Condor

ARGONNE  CHICAGO Ian Foster Resource Management Architecture “10 GFlops, EOS data, 20 Mb/sec -- for 20 mins” Metacomputing Directory Service GRAM Resource Broker Info service: location + selection Globus Resource Allocation Managers GRAM Fork LSF EASYLL Condor etc. “What computers?” “What speed?” “When available?” “50 processors + storage from 10:20 to 10:40 pm” “20 Mb/sec”

ARGONNE  CHICAGO Ian Foster Globus Security Infrastructure Job Manager GRAM client API calls to request resource allocation and process creation. MDS client API calls to locate resources Authentication Query current status of resource Create RSL Library Parse Update MDS with resource state information Request Allocate & create processes Process Monitor & control Site boundary GRAM ClientMDS Gatekeeper GramReporter Local Resource Manager Local Resource Management

ARGONNE  CHICAGO Ian Foster l Provide end-to-end Quality of Service to applications. This requires: u Discovery and selection of resources u Allocation of resources u Advance reservation of resources Supercomputer Workstation Supercomputer Workstation Advanced Resource Management

ARGONNE  CHICAGO Ian Foster GARA and Differentiated Services Server Diffserv Resource Manager Client GARA API Diffserv Resource Manager

ARGONNE  CHICAGO Ian Foster Scheduling Bulk Transfer and High-Priority Transfers

ARGONNE  CHICAGO Ian Foster Integrated Policy Management l Required to control reservation and scheduling l Determine who can to what to whom u Integral part of resource management l Resource  application, application  resource l Next step after authentication l Need to integrate with and augment existing approaches u Access control lists, capabilities, usage certificates

ARGONNE  CHICAGO Ian Foster Policy: Technical Approaches l Single API to alternative mechanisms u Similar to security infrastructure u Integration with Globus security model and Globus resource management components u Basic policy mechanism in current system l Research questions u Reusable policy structures for resource specification/management u Policy aware resource discovery/scheduling

ARGONNE  CHICAGO Ian Foster Grid Services (4): Storage and I/O Services l Access to remote data (GASS) u Uniform access to diverse storage management systems u Cache management u High-speed, secure transport: gsiftp u Integration with metadata & storage systems l Communication (Nexus, GlobusIO) u Application-level interfaces to comm services u Multiple methods: reliable/unreliable, IP/other, unicast/multicast u Quality of service interfaces

ARGONNE  CHICAGO Ian Foster

ARGONNE  CHICAGO Ian Foster Current Technology Focus Areas l Advanced resource management techniques u GARA: Globus Arch. for Resv. & Allocation l High-end data-intensive applications u “Data Grid” l Interfaces to commodity technologies u CoG Kit: Commodity Grid Toolkits l Distance visualization u NOVA: Network Optimized Visualization Arch. With supporting work on info/instr., policy, accounting, authentication/authorization, etc.

ARGONNE  CHICAGO Ian Foster The Grid Forum l IETF-like community forum for discussion & definition of Grid infrastructure l First two meetings (June 16-18, Oct 18-20) attracted 150 people l 9 working groups established in security, information infrastructure, resource management, accounting, etc. l Next mtg: San Diego March l See also European Grid Forum u

ARGONNE  CHICAGO Ian Foster -Grid (“Broadband Experimental Terascale Access”) l A proposal to NSF to plan (& build) a national infrastructure for computer systems research u dedicated to research u of a scale that permits realistic experimentation u of a scale that encourages participation by adventurous applications groups u a place for computer and application scientists to tackle problems together l Initial plan is for O(20) Linux clusters, each with O(30) nodes, O(2 TB) disk, Gb/s network

ARGONNE  CHICAGO Ian Foster Summary: Where We Are l Solid technology base for security, resource management, information services l Globus v1.1 completed, with all core services complete, robust, and documented l Many tool projects are leveraging this considerable investment in infrastructure l Substantial deployment activities and application experiments l New R&D in commodity grids, resource management, distance viz, data grids

ARGONNE  CHICAGO Ian Foster tomographic reconstruction real-time collection wide-area dissemination desktop & VR clients with shared controls Advanced Photon Source Case Study 1: Online Instrumentation archival storage DOE X-ray source grand challenge: ANL, USC/ISI, NIST, U.Chicago

ARGONNE  CHICAGO Ian Foster Case Study 2: Distributed Supercomputing SF-Express Distributed Interactive Simulation: Caltech, USC/ISI l Starting point: SF-Express parallel simulation code l Globus mechanisms for u Resource allocation u Distributed startup u I/O and configuration u Fault detection l 100K vehicles (2002 goal) using 13 computers, 1386 nodes, 9 sites NCSA Origin Caltech Exemplar CEWES SP Maui SP

ARGONNE  CHICAGO Ian Foster OVERFLOW with latency-tolerant algorithms MPICH-G “Grid-enabled” message passing Globus services SecurityDirectoryScheduling Process mgmtCommunication ARC SGI O2000 (California) Argonne SGI O2000 (Illinois) OVERFLOW simulation: NASA Ames

ARGONNE  CHICAGO Ian Foster Case Study 3: Collaborative Engineering CAVERNsoft: UIC Electronic Visualization Laboratory l Manipulate shared virtual space, with u Simulation components u Multiple flows: Control, Text, Video, Audio, Database, Simulation, Tracking, Haptics, Rendering l Uses Globus comms: (un)reliable uni/multicast l Future: Security, QoS, allocation, reservation

ARGONNE  CHICAGO Ian Foster Case Study 4: High-Throughput Computing Nimrod-G: Monash University Cost Deadline Available Machines l Schedule many independent tasks (e.g., parameter study) l Uses Globus security, discovery, data access, scheduling l Future: Reservation, accounting, code management, etc.

ARGONNE  CHICAGO Ian Foster l Problem solving environment for comp. chemistry l Globus services used for authentication, remote job submission, monitoring, and control l Future: distributed data archive, resource discovery, charging Case Study 5: Problem Solving Environment ECCE’: Pacific Northwest National Laboratory