Hi,
I would bet on you having filled the GPU task queue and so you now have to wait for stuff to be finished on the GPU before queuing more work.
The GPU api is asynchronous, so here, you only meansure the time to launch the jobs.
You can add torch.cuda.synchronize() before your timing if you want to measure the time it actually takes to compute the result.