Hey !
I have 4 gpu in my machine. I trained a model with 1 gpu then with 4 gpu.
But the training in 4 gpu is too long.
I guess its because I have to load my model on each gpu (that is the things that make this so slow).
Someone have a solution because loading my models in all the gpu seems to slow.
Thanks