(Tutorials I read teach NOT to push all data onto the GPU)
I understand things better now. In fact, you convinced me to give up my approach and adopt best practices right now (even on MNIST or CIFAR10). Thanks a million for your explanation and time.