smth:

mp.Manager().Queue() is very likely not overriding these functions that will use our ForkingPickler (which shared CUDA memory etc. etc.)


Yes, I think that is indeed the issue - we are using multiprocessing.ForkingPickler and not the torch version. Let me see if I can try to fix this in a PR.



 smth:

You dont actually need to hold onto those Tensors, I was just hoping that it’d give some debugging insights.


Does it point to some bug, in that case?