I trained my model with image size 512x512 and GPU RTX2080 11GB. It has been trained 7 epochs and crash. I don’t know the reason for this problem. If it doesn’t have enough VRAM, then it will catch an error at the beginning. Here is my nvidia-smi checking at the beginning:

image926×121 33.7 KB