I have 2 questions regarding fine-tuning t5:-


Is there anyway to change the lm_head on T5ForConditionalGeneration to intiliaze it from scratch to support new vocabulary size ?
I did it by changing the T5ForConditionalGeneration code and add a new layer called final_layer, but I was wondering if there is an easier way.


Is T5 generate method use teacher forcing or not ?