Why do you say this? I am training a densenet from scratch and I check the validation accuracy by switching the model to .eval().
Densenet implementation is here and it has batch norm layers in it (which are also present during training I believe): https://github.com/pytorch/vision/blob/master/torchvision/models/densenet.py 22