cudnn benchmarking will try different algorithms for your input shape and model.
Some algorithms trade memory for speed, so you might see a higher memory usage and a slowdown (due to multiple profiling runs) for the first iteration.
This shouldn’t yield to an OOM error, as cudnn shouldn’t use an algo which uses too much memory.