@valhalla Thanks for providing the information. This helps.
I am looking to work with sequences greater than 4096 (longformer handles until seq length = 4096).
Reformer model looked promising but since currently we don’t have any trained model. I am looking at other options, I have heard breaking up the text in smaller length and averaging out the results of the classification, is one approach. But I am not sure about the approach. Any reference/thoughts would help.
Thank you