I guess you’re testing with a large tensor and experiencing memory stalls (nvidia’s profiler can report this). Maybe there is also some overhead for attaching “custom” backward into autograd, not sure here.