Hi ptrblck,
Sorry if I wasn’t clear enough. But you have understood correctly. the only difference in “training iteration” and “inference loop” is I am not backpropagating losses and doing “optimizer.step()” in “inference loop”. Otherwise they are the same.  First I am running training loop then inference loop. (loop just denotes looping over data once. same data (train_dataloader) is being used in both cases).