With “effect of activating/deactivating the gradient calculation” I am referring to the output tensor of each layer.


Yes! So even if the gradient has not been deactivated no weight will be modified in the evaluation mode (calling model.eval())?