Sorry I forgot to do so, my GPU is 2080 RTX. As for the specific model size I have 2 hidden layers and 200 hidden units, and 51 class. Moreover, the error does not occur right away, it occurs early on in the training loop, I will try to check the size and content of that batch, to see if it is related.