hello @ptrblck, do you mean the code (let us say code 1) which shows the dependence up on the cudnn.benchmark,or the one  (code 2) which exhibits the hieratic behaviour of the  test loss compared to the train loss (this is the original plot on top of this thread)?
Thanks
PS: Meanwhile, I will rerun the code 1