Solved by ptrblck in post #2 
              
              
                cudnn benchmarking will try different algorithms for your input shape and model. 
Some algorithms trade memory for speed, so you might see a higher memory usage and a slowdown (due to multiple profiling runs) for the first iteration. 
This shouldn’t yield to an OOM error, as cudnn shouldn’t use an a…