Solved by vadimkantorov in post #6 
              
              
                @tom I found a bug in my benchmarking. So this is no longer relevant  I still updated the caching allocator issue for the usecase of debugging save_for_backward.