I mean the model trains in GPU and also loss calculated in GPU, but reading data and batches are in CPU?
I don’t know about mixed-precision training, What is it used for ?
I just want to solve error CUDA out of memory to train with larger batch size than 4 !