input token embedding issues
1. During fine-tuning an XLNet, does the word embeddings kept constant (learned from the pre-trained model) or are they initialized randomly but learned contextually during fine-tuning itself? 

2. And how would I set my own word embeddings during fine-tuning (XLNetForSequenceClassification)? I have my own token embeddings that I want to feed for my XLNetForSequenceClassification and is it possible to keep this embeddings constant during fine-tuning? 
get_input_embeddings and set_input_embeddings functions does not seem to work with XLNetForSequenceClassification Class. 

Thanks!
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
