It’s training now, and the gpu is only using 7293MiB / 12189MiB. Since the crash happens almost at random, it’s difficult to pin down. I’m currently scaling the shortest image side to 800 pixels, but could try reducing that to 600 pixels and seeing whether the issue arises. My batch size is already 1 image.