This recipe is used to train a full MNIST classifier in a distributed way. This recipe is inspired by the blog post in http://ischlag.github.io/2016/06/12/async-distributed-tensorflow/ and the code running on TensorFlow 1.2 is available here https://github.com/ischlag/distributed-tensorflow-example