I load my trained model from checkpoint for a fine-tune training.
then when I do:
model.eval()
model(x)
output seems OK, loss scale is same as at the end of pre-train.
but for:
model.train()
model(x)
output is totally different, very bad - just like it’s a “training from scratch”.

the model pretrained with DDP
the model has BN layers

Am I doing something wrong?
Thanks