Thank you for your response.
I Used SGD before it’s still the same and It works for the batch size of 10.
But I can’t decrease my batch size as my dataset is very large with 500k images almost and it does have 43 classes. If I am using 10 batch size it’s not learning well.
So, I am looking for anyway by which I can increase the batch size or want to know if my 20GB of 2 GPU’s memory is memory is not enough to run even the smallest Resnet.