Hi @ptrblck thank you again for your reply. Is there a way by which I can check if the GPU memory doesn’t get cleared between subsequent iterations?(on the second GPU especially) I suspect this could be happening as the single GPU training works perfectly fine for me, even at batchsize=current_batch*8. It’s just the multi-GPU case which crashes, despite two same cards.



 ptrblck:

The docs explain the general use case and this notebook gives you an example (the notebook is quite old by now, but should still give you an idea of the usage).


Sure, I will have a look, thanks!
Regards,