Hi,
If you’re runnning on cuda, you need to add the appropriate torch.cuda.synchronize() to make your timings accurate (keep in mind that all the CUDA api is asynchronous).
Also how big a difference do you see?