Solved by albanD in post #2 
              
              
                Hi, 
We use a special caching allocator that is much faster than the regular allocator. If you don’t need that memory, I would advise against clearing the cache. If you really need that memory, you can use cuda.empty_cache() to release it.