Hi all,
I would like to train a T5 model (t5-base version) without loading the pretrained weights, if I write the following:
from transformers import T5Config, T5Model
config = T5Config.from_pretrained(‘t5-base’)
model = T5Model(config)
It will produce the t5-base sized T5 model without loading the checkpoint weights?
Thanks