Company LOGO Parallel Virtual Machine Issued by: Ameer Mosa Al_Saadi 1 University of Technology Computer Engineering and Information Technology Department

Agenda 1. High Power Computing (HPC) 1. High Power Computing (HPC) 2. Computing platform evaluation 2. Computing platform evaluation 3. Orientation toward PVM 3. Orientation toward PVM 4. Initiation PVM from console 4. Initiation PVM from console 2 5. PVM configuration 5. PVM configuration 6. Abstract PVM library command 6. Abstract PVM library command 7. Compile and Running program 7. Compile and Running program 8. Ten Years of Cluster Computing 8. Ten Years of Cluster Computing

3 High Power Computing (HPC) Drivers We need to Solve grand challenge applications using computer modeling, simulation and analysis. Life Sciences CAD/CAM Aerospace Military Applications Digital Biology Military Applications E-commerce/anything The world of modern computing potentially offers many helpful methods and tools for scientific and engineering to help them to applying theories, methods, and original applications in such areas as : 1.Parallelism. 2. large-scale simulations. 3.time-critical computing. 4.computer-aided design. Use of computers in manufacturing, visualization of scientific data, and human- machine interface technology. The world of modern computing potentially offers many helpful methods and tools for scientific and engineering to help them to applying theories, methods, and original applications in such areas as : 1.Parallelism. 2. large-scale simulations. 3.time-critical computing. 4.computer-aided design. Use of computers in manufacturing, visualization of scientific data, and human- machine interface technology.

4 How to Run App. Faster ? c There are 3 ways to improve performance: –1. Work Harder –2. Work Smarter –3. Get Help parallelism. c Computer Analogy –1. Use faster hardware: e.g. reduce the time per instruction (clock cycle). –2. Optimized algorithms and techniques –3. Multiple computers to solve problem: That is, increase no. of instructions executed per clock cycle.

Progress Diagram Computer Food Chain Computer Food Chain (Now and Future) Computer Food Chain (Now and Future) 1994 Computer Food Chain 1994 Computer Food Chain 1984 Computer Food Chain 1984 Computer Food Chain Phase 1 Phase 2 Phase 3 5

Computing platform evaluation 6

Orientation toward PVM 7  How can I do computer parallelism?  Answer\\By Some Message Passing System.  What is Message Passing? Why Do I Care? Message passing allows two processes to: Exchange information Synchronize with each other. From here appearing needed to the tool like Parallel Virtual Machine (PVM)

PVM Resources 8 Web site Book PVM: Parallel Virtual Machine A Users' Guide and Tutorial for Networked Parallel Computing Al GeistAl Geist, Adam Beguelin, Jack Dongarra, Weicheng Jiang, Robert Manchek, Vaidy SunderamAdam BeguelinJack DongarraRobert ManchekVaidy Sunderam

PVM definition 9 PVM is a software tool for parallel networking of computers. PVM is a software tool provide single interface and environs to exploit resources on heterogeneous computers interconnected by network for execute tasks with help message system, to be used as a coherent and flexible concurrent computational resource, or a "Parallel Virtual Machine"

Popular PVM Uses 10 Poor man’s Supercomputer Beowulf (PC) clusters, Linux, Solaris, NT Cobble together whatever resources you can get Metacomputer linking multiple Supercomputers ultimate performance: eg. have combined nearly 3000 processors and up to 53 supercomputers Education Tool teaching parallel programming academic and thesis research

What Must provide PVM? 11 Resource Management add/delete hosts from a virtual machine Process Control spawn/kill tasks dynamically Message Passing blocking send, blocking and non-blocking receive, mcast Dynamic Task Groups task can join or leave a group at any time Fault Tolerance VM automatically detects faults and adjusts Heterogeneous Virtual Machine support for:

PVM Model 12 PVM daemon (pvmd3 or pvmd ): run in each node for accepting remote connection and connecting to remote machines. Interface (PVM library – libpvm3.a): library with functions for (send or receive task)programmer use with (C, C++, Fortran). Environs : execution units(processors), memories and network….etc. 12 PVM communication Lib pvm3 User program Lib pvm3 User program pvmd3 Lib pvm3 User program Lib pvm3 User program pvmd3 Application #1Application #2 12

PVM (Physical Vs Logical View)‏ 13

Levels of Parallelism 14 Task i-l Task i Task i+1 func1 ( ) {.... } func1 ( ) {.... } func2 ( ) {.... } func2 ( ) {.... } func3 ( ) {.... } func3 ( ) {.... } a ( 0 ) =.. b ( 0 ) =.. a ( 0 ) =.. b ( 0 ) =.. a ( 1 )=.. b ( 1 )=.. a ( 1 )=.. b ( 1 )=.. a ( 2 )=.. b ( 2 )=.. a ( 2 )=.. b ( 2 )= x x Load PVM Threads Compilers CPU 14

PVM Task 15 Parallel compute is divided into sequence tasks, which can execute parallel. Tasks is can start on separate nodes, where execute is not migration. Each task has a one identification TID, which is create by PVM daemon. Message addressing by help TID. Tasks can rang to groups. Task is implementing as OS process. 15

PVMd – daemond execute 16 1.Master : usually start from control command. 2.Create socket to communicate with tasks and pvmd. 3.Read hostfile. 4.Start slave pvmd- on remote node. 5.Slave : receive parameters from master through arguments and configuration message. 6.Return results to master. 7.Master: wait all tasks to end then find final results.

Initiation PVM from console 1. # pvm Pvm> 2.#pvm hostfile - hostfile : content list(index) nodes, which have be component of PVM (on each row one name). 17

PVM configuration Instruction PVM in console: 1.Add host name, delete host name. 2.Conf (extract actual configuration). 3.Halt (Stand off environs ). 4. quit (end console ). 5.Spawn (initiation new task). 18

19

XPVM XPVM screen shot provides visual information about machine utilization, flows, configuration PVM Cluster 20

Abstract PVM library command exit create spawn send receive execute Program steps 21 recognize To create task id “”TID: tid = pvm_mytid (); To spawn tasks to another computers: numt = pvm_spawn(); To recognize worker from supervisor : pvm_parent(); To send require data to task “TID”: pvm_pkdatatype (); pvm_send (); To receive result from workers or reveres : pvm_recv (); pvm_upkdatatype (); To exit Pvm execute : pvm_exit (); N d

Ex. Program #include #include "pvm3.h" main() { int cc, tid; char buf[100]; printf("i'm t%x\n", pvm_mytid()); cc = pvm_spawn("hello_other", 0, 0, "", 1, &tid); if (cc == 1) printf(“start hello_other\n"); else printf("can't start hello_other\n"); If( pvm_parent()==PVMNOPARENT) ;{ cc = pvm_recv(-1, -1); pvm_bufinfo(cc, 0, 0, &tid); pvm_upkstr(buf); printf("from t%x: %s\n", tid, buf); } pvm_exit(); exit(0); } 22

Hello World – PVM Style Process A Initialize Send(B, “Hello World”) Recv(B, String) Print String “Hi There” Finalize Process B Initialize Recv(A, String) Print String “Hello World” Send(A, “Hi There”) Finalize 23

Compile and Running program To compile Any cpp program in Linux OS can use command: # g++ hello.cpp To compile Any cpp program in Linux OS can use command: # g++ hello.cpp To Running Any cpp program in Linux OS can use command: #./a.out To Running Any cpp program in Linux OS can use command: #./a.out 24

Ten Years of Cluster Computing PVM-1PVM-2PVM-3PVM-3.4 Harness Wide-area GRID experiments Building a Cluster Computing Environment for 21 st Century Networks of Workstations PC Clusters 25

The End 26

27 Mainframe Vector Supercomputer Mini Computer Workstation PC 1984 Computer Food Chain

1994 Computer Food Chain 28 Mainframe Vector Supercomputer MPP Workstation PC Mini Computer (hitting wall soon) (future is bleak)

Computer Food Chain (Now and Future) 29

30 Abstract PVM library command To create task id “”TID: tid = pvm_mytid (); To spawn tasks to another computers: numt = pvm_spawn(); To spawn tasks to another computers: numt = pvm_spawn(); To recognize worker from supervisor computer: pvm_parent() To recognize worker from supervisor computer: pvm_parent() To send require data to task “TID”: pvm_pkdatatype (); pvm_send (); To send require data to task “TID”: pvm_pkdatatype (); pvm_send (); To receive result from workers to each task “TID” or reveres : pvm_recv (); pvm_upkdatatype (); To receive result from workers to each task “TID” or reveres : pvm_recv (); pvm_upkdatatype (); To exit Pvm execute : pvm_exit ();

31