Presentation is loading. Please wait.

Presentation is loading. Please wait.

MPI Send/Receive Blocked/Unblocked Tom Murphy Director of Contra Costa College High Performance Computing Center Message Passing Interface BWUPEP2011,

Published byFrederica George Modified over 9 years ago

Similar presentations

Presentation on theme: "MPI Send/Receive Blocked/Unblocked Tom Murphy Director of Contra Costa College High Performance Computing Center Message Passing Interface BWUPEP2011,"— Presentation transcript:

1 MPI Send/Receive Blocked/Unblocked Tom Murphy Director of Contra Costa College High Performance Computing Center Message Passing Interface BWUPEP2011, UIUC, May 29 - June 10 2011

2 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Where are we headed? Blocking Easiest, but might waste time Send Communication Modes (same Receive) Non Blocking Extra things that might go wrong Might be able to overlap wait with other stuff Send/Receive and their friends in focusing on Send and Receive

3 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 From where‘d we come? MPI_Init (int *argc, char ***argv) MPI_Comm_rank (MPI_Comm comm, int *rank) MPI_Comm_size (MPI_Comm comm, int *size) MPI_Send( void* buf, int count, MPI_Datatype datatype, int dest, int tag, MPI_Comm comm) MPI_Recv( void* buf, int count, MPI_Datatype datatype, int source, int tag, MPI_Comm comm, MPI_Status *status) MPI_Finalize () 3 6 MPI commands

4 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Four Blocking Send Modes Send is the focus MPI_RECV works with all Sends Four Send modes to answer the questions … Do an extra copy to dodge synchronization delay? How do Sends/Receives Start/Finish together? No change to parameters passed to send or receive What does change is the name of the function MPI_Ssend, MPI_Bsend, MPI_Rsend, and MPI_Send 4 basically synchronous communication

5 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 4 Blocking Send modes Synchronous – Stoplight Intersection No buffer, but both sides wait for other Buffered – The roundabout You construct Explicit user buffer, alls well as long as within buffer Ready – Fire truck Stoplight Override No buffer, no handshake, Send is the firetruck Standard – The Roundabout Not so standard blend of Synchronous and Buffered Internal buffer? 5 all use same blocking receive

6 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Exploring Blocking Send/Receive Commands to execute su - list-packages Select mpiBasics2 and press OK exit cd /usr/local/mpiBasics2 mpicc -o deadlock deadlock.c mpirun -np 2 deadlock order msgLen mode order is R(receive first), S(send first), or A(alternate) mode is B(Buffered), R(Ready), S(Synchronous), or V(Standard) 6 BCCD list-packages tool

7 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Synchronous MPI_Ssend Send can initiate, before Receive starts Receive must start, before Send sends anything Safest and most portable Doesn’t care about order of Send/Receive Doesn’t care about any hidden internal buffer May have high synchronization overhead 7 no buffer

8 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Buffered MPI_Bsend Send can complete, before Receive even starts Explicit buffer allocation, via MPI_Buffer_attach Error, if buffer overflow Eliminates synchronization overhead, at cost of extra copy 8 explicit user defined buffer

9 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Ready MPI_Rsend Receive must initiate, before Send starts Minimum idle Sender, at expense of Receiver Lowest sender overhead No Sender/Receiver handshake As with Synchronous No extra copy to buffer As with Buffered and Standard 9 no buffer - no synchronization

10 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Standard MPI_Send Buffer may be on send side, receive side, or both Could be Synchronous, but users expect Buffered Goes Synchronous, if you exceed hidden buffer size Potential for unexpected timing behavior 10 mysterious internal buffer

11 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Non-Blocking Send/Receive Call returns immediately, which allows for overlapping other work User must worry about whether … Data to be sent is out of the send buffer Data to be received has finished arriving For sends and receives in flight MPI_Wait – blocking - you go synchronous MPI_Test – non-blocking - Status Check Check for existence of data to receive Blocking: MPI_Probe Non-blocking: MPI_Iprobe 11 basically asynchronous communication

12 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Non-Blocking Call Sequence 12 Restricts other work you can do Don’t use data till receive completes Don’t write to send buffer till send completes requestID -> MPI_Wait MPI_Irecv ->requestID requestID ->MPI_Wait MPI_Isend ->requestID ReceiverSender

13 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Non-blocking Send/Receive MPI_Isend( void * buf, int count, MPI_Datatype datatype, int dest, int tag, MPI_Comm comm, MPI_Request *request) MPI_Irecv( void * buf, int count, MPI_Datatype datatype, int source, int tag, MPI_Comm comm, MPI_Request *request ) 13 request ID for status checks

14 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Return to blocking Waiting on a single send MPI_Wait(MPI_Request * request, MPI_Status *status ) Waiting on multiple sends (get status of all) Till all complete, as a barrier MPI_Waitall(int count, MPI_Request *requests, MPI_Status *statuses) Till at least one completes MPI_Waitany(int count, MPI_Request *requests, int *index, MPI_Status *status) Helps manage progressive completions int MPI_Waitsome(int incount, MPI_Request *requests, int *outcount, int *indices, MPI_Status *statuses) 14 waiting for send/receive to complete

15 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Tests don’t block Flag true means completed MPI_Test(MPI_Request *request, int *flag, MPI_Status *status) MPI_Testall(int count, MPI_Request *requests, int *flag, MPI_Status *statuses) int MPI_Testany(int count, MPI_Request *requests, int *index, int *flag, MPI_Status *status) Like a non blocking MPI_Waitsome MPI_Testsome(int incount, MPI_Request *requests, int *outcount, int *indices, MPI_Status *statuses) 15 but give you same info as a wait

16 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Probe to Receive Probes yield incoming size Blocking Probe, wait til match MPI_Probe(int source, int tag, MPI_Comm comm, MPI_Status *status) Non Blocking Probe, flag true if ready MPI_Iprobe(int source, int tag, MPI_Comm comm, int *flag, MPI_Status *status) 16 you can know something's there

17 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Non-Blocking Advantages Avoids Deadlock Decreases Synchronization Overhead Best to Post non-blocking sends and receives as early as possible Do waits as late as possible Otherwise consider using blocking calls 17 fine-tuning your send and receives

18 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Illustrative sample code “deadlock” facilitates test of the four blocking send modes Also serves as example code using these modes How to use it: Two processors are each going to each do a send and receive First parameter specifies whether both send(S) first, or both receive first(R), or one first sends and the other first receives (A) Second parameter specifies how many bytes of data to send Third parameter specified which send mode to use: MPI_Ssend(S), MPI_Bsend (B), MPI_Rsend (R ), or MPI_Send(S) mpirun command line mpirun -np 2 deadlock [SRA] mesg_len [SBRV] 18 sometimes causing deadlock

19 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 MPI Hello World Fire up a qsub interactive shell on AC ssh @ac.ncsa.uiuc.edu cp ~tra5/deadlock.c qsub –I mpdstartup mpicc –o deadlock deadlock.c mpirun -np 4./deadlock 19 Lets explore some code

20 MPI Send/Receive Blocked/Unblocked BWUPEP2011, UIUC, May 29 - June 10 2011 Lab exercise using “deadlock” code Parameter study Which parameters result is a successful run? If a parameter set fails, why does it fail? Is there a message length such that ½ the length and twice the length have two different behaviors? For what modes does this happen? Code change questions What happens if you make the code non-blocking? What happens if you modify the code so sends block, but receives are non blocking? Vice-versa? 20 explore by using/changing code

Download ppt "MPI Send/Receive Blocked/Unblocked Tom Murphy Director of Contra Costa College High Performance Computing Center Message Passing Interface BWUPEP2011,"

Similar presentations

MPI Message Passing Interface

MPI Message Passing Interface
1 Non-Blocking Communications. 2 #include int main(int argc, char **argv) { int my_rank, ncpus; int left_neighbor, right_neighbor; int data_received=-1;

1 Non-Blocking Communications. 2 #include int main(int argc, char **argv) { int my_rank, ncpus; int left_neighbor, right_neighbor; int data_received=-1;
MPI Basics Introduction to Parallel Programming and Cluster Computing University of Washington/Idaho State University MPI Basics Charlie Peck Earlham College.

MPI Basics Introduction to Parallel Programming and Cluster Computing University of Washington/Idaho State University MPI Basics Charlie Peck Earlham College.
Sahalu Junaidu ICS 573: High Performance Computing 8.1 Topic Overview Matrix-Matrix Multiplication Block Matrix Operations A Simple Parallel Matrix-Matrix.

Sahalu Junaidu ICS 573: High Performance Computing 8.1 Topic Overview Matrix-Matrix Multiplication Block Matrix Operations A Simple Parallel Matrix-Matrix.
1 Buffers l When you send data, where does it go? One possibility is: Process 0Process 1 User data Local buffer the network User data Local buffer.

1 Buffers l When you send data, where does it go? One possibility is: Process 0Process 1 User data Local buffer the network User data Local buffer.
High Performance Computing

High Performance Computing
Reference: / Point-to-Point Communication.

Reference: / Point-to-Point Communication.
A Message Passing Standard for MPP and Workstations Communications of the ACM, July 1996 J.J. Dongarra, S.W. Otto, M. Snir, and D.W. Walker.

A Message Passing Standard for MPP and Workstations Communications of the ACM, July 1996 J.J. Dongarra, S.W. Otto, M. Snir, and D.W. Walker.
Distributed Memory Programming with MPI. What is MPI? Message Passing Interface (MPI) is an industry standard message passing system designed to be both.

Distributed Memory Programming with MPI. What is MPI? Message Passing Interface (MPI) is an industry standard message passing system designed to be both.
Lesson2 Point-to-point semantics Embarrassingly Parallel Examples.

Lesson2 Point-to-point semantics Embarrassingly Parallel Examples.
Comp 422: Parallel Programming Lecture 8: Message Passing (MPI)

Comp 422: Parallel Programming Lecture 8: Message Passing (MPI)
Please visit our web site: Point-to-Point Communication.

Please visit our web site: Point-to-Point Communication.
MPI Point-to-Point Communication CS 524 – High-Performance Computing.

MPI Point-to-Point Communication CS 524 – High-Performance Computing.
Lecture 8 Objectives Material from Chapter 9 More complete introduction of MPI functions Show how to implement manager-worker programs Parallel Algorithms.

Lecture 8 Objectives Material from Chapter 9 More complete introduction of MPI functions Show how to implement manager-worker programs Parallel Algorithms.
1 Tuesday, October 10, 2006 To err is human, and to blame it on a computer is even more so. -Robert Orben.

1 Tuesday, October 10, 2006 To err is human, and to blame it on a computer is even more so. -Robert Orben.
A Brief Look At MPI’s Point To Point Communication Brian T. Smith Professor, Department of Computer Science Director, Albuquerque High Performance Computing.

A Brief Look At MPI’s Point To Point Communication Brian T. Smith Professor, Department of Computer Science Director, Albuquerque High Performance Computing.
CS 179: GPU Programming Lecture 20: Cross-system communication.

CS 179: GPU Programming Lecture 20: Cross-system communication.
A Message Passing Standard for MPP and Workstations Communications of the ACM, July 1996 J.J. Dongarra, S.W. Otto, M. Snir, and D.W. Walker.

A Message Passing Standard for MPP and Workstations Communications of the ACM, July 1996 J.J. Dongarra, S.W. Otto, M. Snir, and D.W. Walker.
Director of Contra Costa College High Performance Computing Center

Director of Contra Costa College High Performance Computing Center
1 MPI: Message-Passing Interface Chapter 2. 2 MPI - (Message Passing Interface) Message passing library standard (MPI) is developed by group of academics.

1 MPI: Message-Passing Interface Chapter 2. 2 MPI - (Message Passing Interface) Message passing library standard (MPI) is developed by group of academics.

Similar presentations

Ads by Google