Solved by albanD in post #2 
              
              
                Hi, 
I’m not sure to understand your goal? 
You want to benchmark the runtime of a single op ? 
If so, you can do: 
base = torch.rand(10, requires_grad=True)
a = base + 1 # The backward of this is an identity so as fast as it can get

a *= b

a.backward(a)

But note that you’re mostly going to measu…