Hi @pietern,
I was running it on one machine with 4 cards in it( trying to train only on 2). I fixed my problem by installing and using nvidia Apex(apex.parallel.multiproc).
Not sure why I had to do this, because I’ve seen people use the same script without any hacks like this.