I am training my models from Google Collab with batch_size = 128 after 1 epoch it has this problem. I don’t know have to fix it with the same batch_size (reduce batch_size to 32 can avoid this problem). Here is Colab spec: driver Version: 460.32.03    CUDA Version: 11.2 
You can find my notebook here 61.
Thanks for your help.