What does the "<s> token" mean in Longformer's global_attention_mask?
This might be a stupid question, but I couldn't find an answer. The documentation says "For example, for classification, the \<s\> token should be given global attention.". I've also checked the original [longformer paper](https://arxiv.org/pdf/2004.05150.pdf), but "\<s\> token" was only mentioned once. Can someone tell me what does it mean? Thanks for any help!
Ok, I got it. That means [CLS] token.