Dzhange:

But I’m training them on 2 cards, which are both not in use.


Could you explain this statement a bit? How are you training them on two cards and why are they not used?
Are you using the env var CUDA_VISIBLE_DEVICES or are you selecting the device directly in the script?