Then that means that your gpu is not able to run all 3 at the same time. You can check that by using nvidia-smi and check the gpu compute usage when using a single of these nets. If it is already 100%, then I would expect that you get no much speedup.