You cannot reduce time using torch.cuda.syncrhonize(), as it’s used to synchronize the code in order to get valid profiling times. As described before, CUDA operations are executed asynchronously, so profiling them without a synchronization yields invalid results.