@ptrblck
What do you mean exactly. Does it means:
load a pretrained model
load a train data set batch
use model.train()
during model(input) insert a print like that
def forward(self, x, reddening):
    out = F.relu(self.bn1(self.conv1(x)))
    out = self.layer1(out)
    out = self.layer2(out)
    out = self.layer3(out)
    print(out.min(),out.max(),out.mean(),out.std())     <-------------
    out = F.avg_pool2d(out, out.size()[3])
    out = self.linear(out)
    return out

And then switch  to model.eval() and do the same with a test set batch.
It is the right protocol?