But aren’t the weights for the LM head stored on cls.predictions? If so, shouldn’t cls.predictions.decoder.bias be initialized from the checkpoint? The weights stored on cls.seq_relationship should be the randomly initialized ones, no?