Thanks; I had tried a few of these recommendations and observed no improvement:


model = torch.jit.script(model) before training

pin_memory=True in loaders

However, I had not realized that tensor.item() caused a synchronization. Is there a recommended way to sum the loss over batches in an epoch without using item()?
(I’ll try the profiler separately…)