Thanks for clarification! Seems like it is synchronization thing resulting inaccurate timing of .item() operation.
Since torch.max() return a int number, does that mean it will call .item() in the end and that is the reason why torch.max seems “slow”?