Solved by ptrblck in post #7 
              
              
                No, there is no user facing API to do so. 

Yes, ran it with the default setup first and compared it to benchmark mode, which didn’t yield a speedup. 

It’s a cudnn “data gradient” kernel, which computes the gradient for the input activation.