Hello everyone, Is there a way to create non bert tokenizer for dpr model? And how much effort it will be to create one?
Maybe someone have experience converting models from original library to transformers (I know there is a script for this, but it doesn’t show what to do with tokenisers).