Solved by DoubtWang in post #2 
              
              
                However, I find that a small tensor will also take up a lot of gpu space. 
[image] 
[image] 
SO, cuDNN library occupies around 750Mb memory. detail