Well, I’ve tried the nightly build with cudnn 8.0.5 and now it’s a lot faster without amp, but still something like 10% slower with amp.
I suppose amp will only get full support when cudnn 8.1.x is available, right? Is there any expected month for it’s release?
I thank you very much for your time and help.