Beginning word ids
tokenizer = AutoTokenizer.from_pretrained("roberta-base")
inputs = tokenizer('in an ideal situation, it works')
print(inputs.word_ids())

Returns
[None, 0, 1, 2, 3, 3, 3, 4, 5, 6, None]

Are there any methods to identify which token is the beginning position for a word 
For example: 
Returns
[None, 1, 1, 1, 1, 0, 0, 1, 1, 1, None]

where 1 is the start token for a given word and 0 is a token that is not the start token for a given word.


This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.