Yeah I’m using one GPU per process. But the code is written in a way that the processes spawn in the __main__ function. Although it wouldn’t be hard to modify it to use the launch script, I just really want to know why all CUDA devices are used by one process. It used to be fine, only cuda:0 is occupied when the device id is not specified. But after a system update, I re-installed CUDA and PyTorch (same version). Now it’s behaving like this. It seems very peculiar to me.