And I do not disagree with that. It is a special token, always in the same position similar to other BOS tokens are used. But when you say that the CLS is only the “weighted average” of other tokens, then that is simply not correct. Terminology is important here. A weighted average is something very specific, and the value for CLS is calculated in a much more intricate way, taking into account both its own embeddings (token/pos) as well as the context.