A way to increase input length limitation?
Hi,

Is there a way to increase input length limitation of 512 tokens?

Maybe something to change in the code?
No way as far as I can tell, this is a fundamental limitation for absolute position pre-trained models (i.e. BERT, GPT, GPT-2)<|||||>Okay thank you!