Hi,
You can check with nvidia-smi but most network are not limited by memory but how much the GPU can compute. It is the field called GPU-Util in nvidia-smi.
If one job already uses 100% (or close), then the GPU is fully used and so the jobs will have to run one after the other, leading to the slower runtime.