I’ve a Bert tokenizer, which is pre-trained on some dataset. Now I want to fine tune some task in-hand with a Roberta model. So in this scenario

Can I use Bert tokenizer output as input to Roberta Model?
Does such kind of setup makes sense between autoregressive and non-autoregressive models, i.e., using Bert tokenizer with XLNet model?
Does these kind of setups make sense?

From what I understand, this can be implemented, but doesn’t make sense. But I can use some experience or clarification in this direction.