XLNet and RoBERTa embeddings
Referring to Jay Alammar's awesome blog post wherein he showed how to create sentence embeddings from BERT (DistilBert as well), can we use the workings he showed here for XLNet and RoBERTa models as well?

http://jalammar.github.io/a-visual-guide-to-using-bert-for-the-first-time/

I was thinking majorly to use everything same what he did for RoBERTa assuming `<s>` token in RoBERTa contains the classification output and  change following lines for XLNet since `<cls>` is at the end of the sequence length unlike in case of BERT where it is at the beginning

`features = last_hidden_states[0][:,-1,:].numpy()`

Any idea if my assumptions are correct?
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
