Hi,
Could you give an example that reproduces this issue?
Seeing
" ```
RuntimeError: Attempted to send CUDA tensor received from another process; this is not currently supported. Consider cloning before sending.
"
makes me think that you are mixing multiprocessing and DDP somehow?

maybe also see:
https://pytorch.org/docs/stable/notes/cuda.html#cuda-nn-ddp-instead