@ptrblck Hello~ torch.cuda.synchronize() guarantees us to count the “real time” of each operation when we analyze the time consumption. Furthermore, will it slow down the training process when used in training code?