Nystromformer Pretrained model with longer sequence length 
The released Nystromformer model only deals with 512 tokens. Will we release some pretrained models with max sequence length such as 1024, 2048 and 4096 mentioned in the paper.

@novice03 @NielsRogge 
Hello, the model for larger sequence lengths might be released in a few weeks.<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.<|||||>Hi,

Nyströmformer trained on sequence length 1024 is available now: https://huggingface.co/uw-madison/nystromformer-1024

Closing this issue.