Thank you for your reply, it’s a lot more clearer now. So just to confirm, I just run the test data for only one iteration of the forward pass with the same learning rate or do I also have to first extract the weights from the last iteration of the training phase?