about the special tokens
## ❓ Questions & Help

<!-- A clear and concise description of the question. -->
The question about roberta.
I konw that Bert use the embedding of token 'cls' to do predict, but when it comes to roberta, I dont know it clearly. Can you tell me which token's embedding is used to do predict in this project? Is it '<s>' ?
Please close this. It's a duplicated of your other question.