ah ok…  It must be possible… I have read some papers where the researchers have trained on 3 and 4 GPU’s (evidenced in their code) so it must be possible… unless they too had problems with it too.  I initially thought it was system specs (PSU, thermal throttling etc) but when I looked at all that it seemed fine.  One of life’s mysteries I guess.