Again, if you don’t synchronize the code via torch.cuda.synchronize(), the next “blocking” operation will accumulate the time from all asynchronous calls.
Please synchronize the code before starting and stopping the timers and feel free to post the results.