http://docs.nvidia.com/deploy/mps/index.html Sharing a GPU Between MPI Processes: Multi-Process Service (MPS) Overview