Collective Communications

• Introduction and Overview
• Operational Details
• Communicator Argument
• Barrier Synchronization
• Broadcast
  • Example Using MPI_BCAST
• Gather
  • Examples Using MPI_GATHER
  • Gather, Vector Variant
  • Examples Using MPI_GATHERV
• Scatter
  • An Example Using MPI_SCATTER
  • Scatter: Vector Variant
  • Examples Using MPI_SCATTERV
• Gather to All
  • An Example Using MPI_ALLGATHER
  • Gather to All: Vector Variant
• All to All Scatter/Gather
  • All to All: Vector Variant
• Global Reduction Operations
  • Reduce
  • Predefined Reduce Operations
  • MINLOC and MAXLOC
  • All Reduce
  • Reduce-Scatter
• Scan
• User-Defined Operations for Reduce and Scan
• The Semantics of Collective Communications