Hi All,
I am trying to finetune DeBerta Model on SQUAD. If I try existing notebooks like this 7 It uses Trainer and Fast Tokenizer.
DeBerta doesn’t have support for Fast Tokenizer Yet. How can I finetune it on SQUAD?
I am also willing to implement Fast Tokenizer for the Deberta model, Can anyone help me with resources so I can get started with that?
Here is my notebook for training Deberta 6 (I am facing issues)