Hi,
I don’t have a specific knowledge on this, but the timing code you shared is not correct for cuda timings:
You need to add a torch.cuda.synchronize() before the second time.time() otherwise you only measure the time to launch the compute on the GPU, not the full execution time.