Thank you for your answer!


I am aware of cudnn’s benchmark features and tried both with them enabled and disabled. Unfortunately enabling cudnn optimization even led to more unstable results.



I already do warmup (i.e. 100 iterations)
I don’t measure isolated runs. In fact I calculate the average over a period of full 6 seconds (can be more then 10k iterations or more)
This sounds promising, I will try that.



Thank you for the link!
I will come back to this thread when I tried the GPU clock lock.