Solved by ptrblck in post #2 
              
              
                Yes, the activations will be scaled automatically. In face this is done during training, while model.eval() just uses the model as it is.