Introduction

Simple examples demonstrating techniques of deep learning model manipulation.

• mnist-nn.py: 3-layer neural network as digit recognizer (MNIST).
• mnist-nn-gpu.py: mnist-nn with GPU computing.
• mnist-nn-data-parallelism.py: mnist-nn with data parallelism (MPI and GPU).

Job file is the wrapper of a MPI command. To distribute a program via MPI, you can indicate the configurations of worknodes (address or hostname, processor numbers, etc.) in a hostfile or CLI. For more details about hostfile, you can refer to Open MPI's Q&A.

Setup development environment

Please refer to .