long text classification
I want to binary classify documents with max length greater than 512 with bert.
Is there any reference or code for how to do this?
Following!<|||||>> Following!

I don't know what it means.
<|||||>Use transformer-XL<|||||>Longformer is exactly designed for your use case (https://github.com/allenai/longformer)<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
<|||||>Reformer and longformer are being worked on to be included in this library.<|||||>Looks like they've got longformer now. 

https://huggingface.co/transformers/model_doc/longformer.html<|||||>Is longformer a multilingual model? or are there options to work with longer texts that are not in English? <|||||>You can also use Text Guide, a clever text truncation method and use a transformer model with a standard 512 limit.
And if you have extremely long text instances (longer than 4096 == Longformer model limit) you can also use this approach to further improve your results.

Paper: https://arxiv.org/abs/2104.07225
Code: https://github.com/krzysztoffiok/TextGuide
A brief description: https://www.quora.com/If-I-have-a-long-text-say-10-paragraphs-how-can-I-use-BERT-or-other-newer-and-better-models-such-as-RoBERTa-for-feature-extraction-that-represents-the-entire-document-Seems-like-BERT-has-limits-Are-there-packages
