Thanks for the information!
So, you are seeing multiple times the cuda:0 output and never cuda:1?
Could you post some code snippets where you create your model and the training loop?
This might be a bit far fetched, but is your GPU1 working without any issues in a single GPU setup?