I don’t alway have to deal with MPI myself, but I recently used it for several projects. I have several questions to share:

  • Does master (rank=0) always the last to finish?
  • Should code wait for all slaves to actually receive the broadcast message?