Hi @ptrblck,
Thanks for your response.
I tried to build PyTorch from source using different versions.
I have tested 1.6, 1.7 and the latest one, 1.9. But all of them are having the same cublas issue.
The memory is not running out when I tested by build.
Because I can run the same code on the same machine changing to the PyTorch version that I directly install using pip.
I believe I have set all the CUDA related environmental variables correctly reflect my system setting; the configure step at the start of the build was able to pick up the corresponding CUDA paths I needed.