Oh, I see. Thanks a lot! Didn’t know about the torch.cuda.amp
It works with the amp and I am able to fit a batch_size twice as big on the GPU now.
One question though, I’m actually experiencing a slowdown with the increase of batch_size
Is this expected behaviour? I was hoping to get the same step execution time, but a bigger batch_size so the epoch gets faster.