Thanks @LeviViana! If my understanding of  torch.distributed.launch is correct, it can be used to distribute compute over multiple GPUs? However, I’d like to parallelize this operation on a single GPU. Ideally, it would be akin to torch.bmm, with the only difference being that instead of a matrix multiplication being batched the CNN forward pass is batched.