I am running different tranings on 3 different GPUs all accessing same data. When running only 1 training, it is much faster than running all 3 (on different GPUs). Is it because all programs are accessing the same data?
Can anyone please answer this?
Thanks.