Thanks.
I’m reconsidering my strategy after coming across this though:
https://discuss.pytorch.org/t/using-cuda-multiprocessing-with-single-gpu/7300/4
For now I’ll focus on multiprocessing without GPUs.