I’m still unsure, how to interpret this statement:



 Tuong_Lam:

Yes, the memory does not change in allocate and cache. But GPU memory usage is still increase until out of memory.


How does the memory increase, if the allocated and cached memory is not changed?
Are you seeing the increase only via e.g. nvidia-smi?