Each list in `nested_token_ids` can't be a complete subset of another list, but is
### Feature request

Enable passing disjunctive constraints (https://github.com/huggingface/transformers/blob/main/src/transformers/generation/beam_constraints.py#L261)
 where one is a subset of the other

### Motivation

in the constrainted beam decoding feature, specifically in the case of disjunctive constraints, currently there is no option for one disjunctive constraint to be a subset of the other, as can be seen here:
https://github.com/huggingface/transformers/blob/main/src/transformers/generation/beam_constraints.py#L220
But, in many cases, this is exactly the case.
For example, if I wanted to consider all the inflections of the verb "sentence": ["sentence", "sentences", "sentenced", "sentencing"], then the tokenizer separates "sentenced" into ["sentence", "d"], which means that "sentence" is a subset of "sentenced".

### Your contribution

N/A
cc @gante<|||||>Hey @lovodkin93 👋  the constraints feature in beam search is experimental, so our efforts are currently limited to fixing bugs. 

If you'd like to add the feature yourself, go for it :) <|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.