Some Questions about XLNet 
## ❓ Questions & Help

<!-- A clear and concise description of the question. -->

1, XLNet is a model with relative position embeddings,  so  can either pad the inputs on the right or on the left ?

2, If i pad the inputs on the left, the length of input is 100 and the max length is 128, i don't consider the PAD token in NER task, i.e.  just use the hidden state of input token,  use  [-100:, :] over the output of model  ? 
For length dimension, the last 100 are taken; for hidden state  dimension, the values of all dimensions are taken.

3, CLS token must be at end ?

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
