When calling loss.item() in the “standard” training loop (e.g. here 14), the operation takes a lot of time (~2 seconds). Is there a way to reduce this bottleneck? I understand that the problem might be the loss being in the GPU…
Thanks!