which special token is used to predict the score in roberta?
In bert, we use the embedding of <cls> to predict the score, how about the roberta?
Can you give some more information? It's not clear what you mean by "score". The special classification token for RoBERTa is `<s>`.<|||||>Thanks!<|||||>@tzhxs If that's everything you need, please close this topic.<|||||>ok