What does ## mean in the bert vocab?
What does ## mean in the bert vocab?

some words are starts with ##, such as ##a ##m ##er ##h ，I don't quite understand。
This question is better suited for [Stack Overflow](https://stackoverflow.com/). Please ask similar questions there in the future.

It indicates that the token is a subword unit, i.e. part of a larger word. For instance, the word "potatoes" might be tokenised as "po, ##ta, ##toes". If you want to learn more about this kind of tokenisation, I suggest you read up on byte-pair encoding and the like.