@ptrblck should i get the same performance for both single gpu and multi-gpu training?
hmmmm not sure what does it mean to reduce the loss… (?)
my loss is like this when I print it [1.255, 54.2] (I have two gpus for this case)
@Thomas_Wolf can you help please?