Solved by Tanya_Boone in post #3 
              
              
                currently I am using opt_level 3 
I started with one GPU no distributed and I could only train with 
image size= 112  (half of 224) 
batch_size = about 60 (half of what I have) 
but now I want to train with 224 and bs 125 and I can’t be possible that I can’t run that with 8 gpus. 
I have another ser…