Hi, so I think what’s most likely happening here is somewhere in your processes meant for gpu 1 and 2 you are calling cuda without explicity assigning to your desired gpu so it goes to your default gpu device 0. Or more likely come to think of it I bet you may be saving the model in process without assigning to desired gpu. Though would be easier to pinpoint if you provided some code to look at.