Introduction to the Message Passing Interface (MPI)
                                                      CPS343
                                    Parallel and High Performance Computing
                                                    Spring 2020
        CPS343 (Parallel and HPC)       Introduction to the Message Passing Interface (MPI)       Spring 2020     1/41
   Outline
    1    The Message Passing Interface
            What is MPI?
            MPI Examples
            Compiling and running MPI programs
            Error handling in MPI programs
            MPI point-to-point communication
            MPI datatypes and tags
        CPS343 (Parallel and HPC)       Introduction to the Message Passing Interface (MPI)       Spring 2020     2/41
   Outline
    1    The Message Passing Interface
            What is MPI?
            MPI Examples
            Compiling and running MPI programs
            Error handling in MPI programs
            MPI point-to-point communication
            MPI datatypes and tags
        CPS343 (Parallel and HPC)       Introduction to the Message Passing Interface (MPI)       Spring 2020     3/41
   What is MPI?
           MPI stands for Message Passing Interface and is a library specification
           for message-passing, proposed as a standard by a broadly based
           committee of vendors, implementors, and users.
           MPI consists of
               1   a header file mpi.h
               2   a library of routines and functions, and
               3   a runtime system.
           MPI is for parallel computers, clusters, and heterogeneous networks.
           MPI is full-featured.
           MPI is designed to provide access to advanced parallel hardware for
                   end users
                   library writers
                   tool developers
           MPI can be used with C/C++, Fortran, and many other languages.
        CPS343 (Parallel and HPC)       Introduction to the Message Passing Interface (MPI)       Spring 2020     4/41