T5 Warning: embeddings are not initialized
```python
from transformers import *
model = T5ForConditionalGeneration.from_pretrained("t5-base")
```

Is this concerning?

```
Some weights of T5ForConditionalGeneration were not initialized from the model checkpoint at t5-base and are newly initialized: ['encoder.embed_tokens.weight', 'decoder.embed_tokens.weight', 'lm_head.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
```

Relatedly, I am porting a summarization checkpoint and wondering whether I should initialize lm_head.
This [comment](https://github.com/huggingface/transformers/issues/3553#issuecomment-624306027) answers this issue.