At http://mpitutorial.com/tutorials/mpi-reduce-and-allreduce/, you can find a good tutorial on this topic and much more.