CUDA operations are asynchronous, so you have to synchronize the code before starting and stopping the timer via torch.cuda.synchronize().
Could you add it to your code and profile the operations again, please?