http://mpitutorial.com The Most Comprehensive MPI Lesson and Tutorial Resource Tue, 31 Dec 2013 19:11:17 +0000 en-US hourly 1 http://mpitutorial.com/performing-parallel-rank-with-mpi/ http://mpitutorial.com/performing-parallel-rank-with-mpi/#comments Sun, 11 Aug 2013 14:56:35 +0000 http://mpitutorial.com/?p=1224 Read more »]]> http://mpitutorial.com/performing-parallel-rank-with-mpi/feed/ 4 In the previous lesson, we went over MPI_Scatter, MPI_Gather, and MPI_Allgather. We are going to expand on basic collectives in this lesson by coding a useful function for your MPI toolkit – parallel rank. The code for this tutorial is available as a tgz file or can be viewed/cloned on GitHub. Parallel rank – problem... Read more » http://mpitutorial.com/mpi-reduce-and-allreduce/ http://mpitutorial.com/mpi-reduce-and-allreduce/#comments Tue, 16 Jul 2013 01:33:24 +0000 http://www.mpitutorial.com/?p=961 Read more »]]> http://mpitutorial.com/mpi-reduce-and-allreduce/feed/ 7 In the previous lesson, we went over an application example of using MPI_Scatter and MPI_Gather to perform parallel rank computation with MPI. We are going to expand on collective communication routines even more in this lesson by going over MPI_Reduce and MPI_Allreduce. The code for this tutorial is available as a tgz file or can... Read more » http://mpitutorial.com/launching-an-amazon-ec2-mpi-cluster/ http://mpitutorial.com/launching-an-amazon-ec2-mpi-cluster/#comments Wed, 05 Dec 2012 04:34:39 +0000 http://dev.mpitutorial.com/?p=994 Read more »]]> http://mpitutorial.com/launching-an-amazon-ec2-mpi-cluster/feed/ 0 In the previous lesson, we discussed how to install MPICH2, an implementation of MPI, onto a single machine and verify that it was installed properly. Unfortunately, a single machine does not always provide a realistic environment on which to learn MPI and execute programs. Along with that, many beginners do not have immediate access to... Read more » http://mpitutorial.com/mpi-scatter-gather-and-allgather/ http://mpitutorial.com/mpi-scatter-gather-and-allgather/#comments Sat, 07 Jul 2012 04:35:30 +0000 http://www.mpitutorial.com/?p=903 Read more »]]> http://mpitutorial.com/mpi-scatter-gather-and-allgather/feed/ 14 In the previous lesson, we went over the essentials of collective communication. We covered the most basic collective communication routine – MPI_Bcast. In this lesson, we are going to expand on collective communication routines by going over two very important routines – MPI_Scatter and MPI_Gather. We will also cover a variant of MPI_Gather, known as... Read more » http://mpitutorial.com/mpi-broadcast-and-collective-communication/ http://mpitutorial.com/mpi-broadcast-and-collective-communication/#comments Thu, 21 Jul 2011 03:35:31 +0000 http://www.mpitutorial.com/?p=788 Read more »]]> http://mpitutorial.com/mpi-broadcast-and-collective-communication/feed/ 6 So far in the beginner MPI tutorial, we have examined point-to-point communication, which is communication between two processes. This lesson is the start of the collective communication section. Collective communication is a method of communication which involves participation of all processes in a communicator. In this lesson, we will discuss the implications of collective communication... Read more » http://mpitutorial.com/point-to-point-communication-application-random-walk/ http://mpitutorial.com/point-to-point-communication-application-random-walk/#comments Sun, 03 Jul 2011 07:14:19 +0000 http://www.mpitutorial.com/?p=551 Read more »]]> http://mpitutorial.com/point-to-point-communication-application-random-walk/feed/ 10 It’s time to go through an application example using some of the concepts introduced in the sending and receiving tutorial and the MPI_Probe and MPI_Status lesson. The code for the application can be downloaded here or can be viewed/cloned on GitHub. The application simulates a process which I refer to as “random walking.” The basic... Read more » http://mpitutorial.com/dynamic-receiving-with-mpi-probe-and-mpi-status/ http://mpitutorial.com/dynamic-receiving-with-mpi-probe-and-mpi-status/#comments Thu, 30 Jun 2011 04:11:44 +0000 http://www.mpitutorial.com/?p=523 Read more »]]> http://mpitutorial.com/dynamic-receiving-with-mpi-probe-and-mpi-status/feed/ 0 In the previous lesson, I discussed how to use MPI_Send and MPI_Recv to perform standard point-to-point communication. I only covered how to send messages in which the length of the message was known beforehand. Although it is possible to send the length of the message as a separate send / recv operation, MPI natively supports... Read more » http://mpitutorial.com/mpi-send-and-receive/ http://mpitutorial.com/mpi-send-and-receive/#comments Wed, 22 Jun 2011 22:06:51 +0000 http://www.mpitutorial.com/?p=446 Read more »]]> http://mpitutorial.com/mpi-send-and-receive/feed/ 15 Sending and receiving are the two foundational concepts of MPI. Almost every single function in MPI can be implemented with basic send and receive calls. In this lesson, I will discuss how to use MPI’s blocking sending and receiving functions, and I will also overview other basic concepts associated with transmitting data using MPI. The... Read more » http://mpitutorial.com/mpi-hello-world/ http://mpitutorial.com/mpi-hello-world/#comments Tue, 21 Jun 2011 00:56:42 +0000 http://www.mpitutorial.com/?p=380 Read more »]]> http://mpitutorial.com/mpi-hello-world/feed/ 12 In this lesson, I will show you a basic MPI Hello World application and also discuss how to run an MPI program. The lesson will cover the basics of initializing MPI and running an MPI job across several processes. This lesson is intended to work with installations of MPICH2 (specifically 1.4). If you have not... Read more » http://mpitutorial.com/installing-mpich2/ http://mpitutorial.com/installing-mpich2/#comments Mon, 20 Jun 2011 22:05:01 +0000 http://www.mpitutorial.com/?p=352 Read more »]]> http://mpitutorial.com/installing-mpich2/feed/ 10 MPI is simply a standard which others follow in their implementation. Because of this, there are a wide variety of MPI implementations out there. One of the most popular implementations, MPICH2, will be used for all of the examples provided through this site. Users are free to use any implementation they wish, but only instructions... Read more »