Hi @ptrblck
Thanks for the reply. I’m actually using DistributedDataParallel. And because of this issue, each spawned process will occupy a small portion of memory on every GPU, which is causing the whole process to hang.