Hi @totoro02,
I faced the same error fine tuning another model, but in my case I needed to lower the batch size from 64 to 16.
I did not applied the torch.no_grad().
In your case, what was lowest batch size you tried?