| Overview of Parallel Computing |
| Point-to-point Communication
|
|
Blocking and
Unblocking Communication |
|
Synchronous and non-Synchronous
Communication; |
|
| User-Defined Data types and Packing |
| Collective Communications
|
|
Barrier
Synchronization; |
|
Broadcast;
|
|
Gather;
|
|
Scatter, |
|
Reduce and Scan
Operations. |
|
| Grouping Data for Communication |
|
| Communicators and Process Topologies |
|
Cartesian
Topology Functions |
|
Graph Topology Functions |
|
| Environment Management
|
|
Environment Inquiries; |
|
Timers and
Synchronizations; |
|
Initializations and
Exit; |
|
Error handling |
|
| MPI Profiling interface |
| Measuring Performance |
Benchmarking Performance |
| Examples of Parallel Algorithms:
|
|
Inner
Product; |
|
Vector-Matrix
Multiplication; |
|
Matrix-Matrix
Multiplication; |
|
LU Decomposition;
|
|
Fast Fourier Transform;
|
|
Maximum
Network Flow; |
|
Parallel
Programming with C and MPI
