ptrblck:

That’s good to hear. So the different memory behavior was observed between your local Windows machine and Colab?


Yes
In google colab, I got a v100 today. I switched the pytorch version to be cu110 from cu101.
However, I didn’t use conda. I was able to do a batch size of 48 without crashing using 16GB - as I have always been able to do using colab.
pip install torch==1.7.1+cu110 -f https://download.pytorch.org/whl/torch_stable.html

get_cuda_version() in colab gave me (‘11.0’, 8005)
I’ll  get the tensors tonight.