Hi @pmeier, I had a similar understanding, however I just found out that the statement:


reserved memory ~= allocated memory after calling torch.cuda.empty_cache()


did not hold true. If that is the case, it would be nice to have a more in depth description of the memory management here:

  
      pytorch.org
  
  
    

CUDA semantics — PyTorch 1.7.0 documentation 127