Thanks for the clarification.
That’s weird. I don’t know why DDP (or sth else) would then try to access a different GPU. Does it work if you set the CUDA_VISIBLE_DEVICES variable to prevent the process from seeing another GPU?