1. Fault Tolerant Grid Workflow in Water Threat Management Master’s project / thesis seminar Young Suk Moon Chair: Prof. Gregor von Laszewski Reader: Observer:

2. Outline Brief summary of Water Threat Management Goal of the project Background for my topic  Dynamic job scheduling  Fault tolerant grid systems My ideas

3. Water Threat Management project Analyzing contamination of water in urban water distribution systems Sensor Data Optimization Engine Grid Resources Middle Ware Simulation Engine (MPI)‏ EPANET find the contaminant source find the optimal solution

4. Goal of the project Problems of the current WTM system (MPI)‏  Not fault tolerant  All computing should restart from the beginning in case of node failure Decision  Change MPI systems to loosely coupled systems

5. Problems to solve Run-time job scheduling Fault tolerance

6. Background: Dynamic resource selection Job Queue Machines Jobs Performance DB Select machine

7. Background: Fault tolerance in grid Replication  Run the same job in multiple nodes  Need more resources Checkpoint-restart  Checkpoint server  Slow due to checkpoint overhead

8. My ideas: Multiple-enqueue and Discard Global Queue Jobs 13542 Machine A Machine C Machine B queue A queue C queue B

9. My ideas: Multiple-enqueue and Discard Global Queue Jobs 681097 Machine A Machine C Machine B 231231231 231231453 231231342 queue A queue C queue B

10. Issues How many duplicated jobs to enqueue How to allocate which jobs to which machines How to divide jobs or input data How to cluster nodes

11. Evaluation Comparison based on the different settings

12. References G. von Laszewski, K. Mahinthakumar, R. Ranjithan, D. Brill, J. Uber, K. Harrison, S. Sreepathi, and E. Zechman, “An Adaptive Cyberinfrastructure for Threat Management in Urban Water Distribution Systems,” in Proceedings of ICCS 2006, vol. 3993, 2006, pp. 401–. S. Sreepathi, “CYBERINFRASTRUCTURE FOR CONTAMINATION SOURCE CHARACTERIZATION IN WATER DISTRUBUTION SYSTEMS,” Master’s thesis, North Carolina State University, 2006 G. von Laszewski, “A Loosely Coupled Metacomputer: Cooperating Job Submissions Across Multiple Supercomputing Sites,” Concurrency, Experience, and Practice, vol. 11, no. 5, pp. 933–948, Dec. 1999 L. Ramakrishnam and D. A. Reed, “Performability modeling for scheduling and fault tolerance strategies for scientific workflows,” in Proceedings of the 17 th international symposium on High performance distributed computing, 2008. S. Ayyub and D. Abramson, “GridRod - A Dynamic Runtime Scheduler for Grid Workflows,” in Proceedings of the 21st annual international conference on Supercomputing, 2007.