1. Grid Toolkits Globus, Condor, BOINC, Xgrid Young Suk Moon

2. Grid Requirements Resource sharing / coordination Resource discovery / management Job managements Security Delegation Monitoring Communication Interoperability http://grid.rit.edu2

3. Comparison to OS Grid RequirementsGridOS Resource sharing/coordination GIIS, GRRPMain memory (heap area) Resource discovery/management GRAMFile systems Job managementQueuing SystemsIR (Instruction Register), process scheduling SecurityGSIPermissions MonitoringGMAStandard output Communicationvia network systemsBuses on computer board http://grid.rit.edu3

4. Needs for Grid Application Developments Standardized mechanisms APIs / SDKs for Grid protocols http://grid.rit.edu4

5. Grid Toolkits Category Globus ToolkitGrid Computing CondorCluster Computing Condor-GGrid Computing BOINCPublic-Resource Computing XgridCluster Computing http://grid.rit.edu5

6. Globus Toolkit Open-source project Software toolkit for Grid applications Being developed by the Globus Alliance www.globus.org www.globus.org www.globus.org http://grid.rit.edu6

7. Globus Toolkit Requirements Resource location & allocation Communications Unified resource information service Authentication interface Process creation Data access http://grid.rit.edu7 Reference: from the slide “Globus: A Metacomputing Infrastructure Toolkit.” p.12.

8. Grid Architecture & Globus: Fabric Layer http://grid.rit.edu8 Access to the resources  Computational resources  Storage resources  Network resources Globus uses existing fabric components  If they do not exist, GT provides the missing components. Grid Protocol Architecture Collective Resource Connectivity Fabric Application

9. Grid Architecture & Globus: Connectivity Layer - 1 http://grid.rit.edu9 Defines communication & authentication protocols  Transport, routing, naming  Verify users & resources Globus Toolkit : Grid Security Infrastructure (GSI)‏  Public-key based  X.509 Grid Protocol Architecture Collective Resource Connectivity Fabric Application

10. Grid Architecture & Globus: Connectivity Layer - 2 Grid Security Requirements – Single sign on – Delegation – Integration with various local security solutions – User-based trust relationships http://grid.rit.edu10

11. Grid Architecture & Globus: Resource Layer http://grid.rit.edu11 Resource managements  Information protocols  Management protocols (process creation, data access)‏ Globus Toolkit  Grid Resource Information Protocol (GRIP)‏  Grid Resource Access and Management (GRAM)‏  GridFTP  Lightweight Directory Access Protocol (LDAP)‏ Grid Protocol Architecture Collective Resource Connectivity Fabric Application

12. Grid Architecture & Globus: Collective Layer http://grid.rit.edu12 Access to “global” resources  Resource discovery  Task scheduling  Monitoring  Authorization Globus Toolkit: Meta Directory Service  Grid Information Index Services (GIISs)‏  Grid Resource Registration Protocol (GRRP)‏ Grid Protocol Architecture Collective Resource Connectivity Fabric Application

13. Condor Cluster computing toolkit Developed at University of Wisconsin Runs on various Operating Systems Provides – Job queuing – Scheduling policy (job allocation, migrations, etc.)‏ – Resource monitoring – Resource management http://grid.rit.edu13

14. Condor Architecture A central manager – Detects idle machines – Matches job requirements to available resources Submit machines – Only submit jobs Full Install machines – Submit & run jobs http://grid.rit.edu14 Cluster Central Manager Submit Full Install Submit Full Install

15. Condor - Flocking http://grid.rit.edu15 Cluster ACluster B Submit Job Run Job No available resources in cluster A Send the job to cluster B Run the job in cluster B

16. Condor-G Grid computing Using the Globus Toolkit Can access a Globus Grid http://grid.rit.edu16

17. Xgrid A Mac OS X application Security Extendability – A plug-in architecture Ease of use http://grid.rit.edu17 http://www.macresearch.org/xgrid-leopard-good-bad- ugly-and-new-stuff

18. How Xgrid is used Ad hoc participation – Programs are run at idle computers Dedicated Grid – Computers are dedicated for programs http://grid.rit.edu18

19. Xgrid Architecture Agent – Runs a job (dedicated mode, screensaver mode)‏ Controller – Queues tasks, scheduling, handles failover Client – Submits jobs to the controller http://grid.rit.edu19

20. Xgrid Architecture Plug-ins – For specific functionalities Networking http://www.beepcore.org/ http://www.beepcore.org/ – BEEP (The Blocks Extensible Exchange Protocol) http://www.beepcore.org/ http://www.beepcore.org/ Security – Xgrid requires a password – MD5 hash http://grid.rit.edu20

21. BOINC Stands for Berkeley Open Infrastructure for Network Computing Public-resource computing – Also known as peer-to-peer computing Different from Grid computing – Grid: resources are owned by organizations (universities, research labs, etc.)‏ – Public-resource: resources are owned by individuals http://grid.rit.edu21

22. BOINC - participants Give “credits” to participants – Need participants to make a more capable system Meter contributions (computation, storage, network transfer, etc.)‏ Participants are interested in their rankings http://grid.rit.edu22

23. BOINC - Examples SETI@home Predictor@home Folding@home Climateprediction.net Climate@home CERN project Einstein@home UCB/Intel study of Internet resources http://grid.rit.edu23

24. BOINC - Features Components – A master URL, scheduling servers, data servers – Tools (Python scripts, C++ interfaces)‏ Redundant computing – Detects errors and compute again Failure / backoff – Congestion control Local scheduling http://grid.rit.edu24

25. References www.globus.org www.globus.org Globus Website: www.globus.orgwww.globus.org Presentation Slides, The Globus Project TM, “The Grid and Globus.” Argonne National Laboratory, JSC Information Sciences Institute. users.sdsc.edu/~ludaesch/ECS289F-W05/ECS289F-W05-16-globus.pdf Presentation Slides, Harhad, F, “Globus: A Metacomputing Infrastructure Toolkit.” International Journal of Supercomputer Applications, 11(2):115-128, 1997. www.cct.lsu.edu/~kosar/csc7700/slides/Lecture05a.pdf Foster, I., Kesselman, C. and Tuecke, S. “The Anatomy of the Grid: Enabling Scalable Virtual Organizations.” International Journal of High Performance Computing Applications, 15 (3). 200-222. 2001. http://www.linuxjournal.com/node/9058/print http://www.linuxjournal.com/node/9058/print Habib, I. “Getting started with condor.” Linux J., 2006(149), 2. Website: http://www.linuxjournal.com/node/9058/print http://www.linuxjournal.com/node/9058/print http://www.cs.wisc.edu/condor/ http://www.cs.wisc.edu/condor/ Condor Website: http://www.cs.wisc.edu/condor/http://www.cs.wisc.edu/condor/ Anderson, D.P. “BONIC: a system for public-resource computing and storage.” Grid Computing, Proceedings. Fifth IEEE/ACM International Workshop on, 4-10. 2004. “Xgrid Guide” Apple Computer, Inc. 1 Infinite Loop, Cupertino, CA 95014. March 17. 2004. http://grid.rit.edu25