Hi there,
I am training on two GPUs and I noticed that the first GPU uses significantly more memory. How can that be? I moved the model to both GPUs with DataParallel.

image.jpg1456×420 188 KB

Thanks for your help.