@ptrblck, thanks for the clarification. How about if requires_grad is set to False ? Will setting model.train() or model.eval() (in terms of Batchnorm and Dropout Layers) make a difference for those layers whose parameters have requires_grad set to False ?
And could you also mention if there are any other layers apart fromBatchNorm and Dropout whose behaviour changes upon using .train() and .eval() ? Thanks!