Error while finetuning XLM-R on Tensorflow-Keras
Hello,

I am trying to finetune XLM-RoBERTa for text classification on tensorflow-keras. I have used XLMRobertaTokenizer base to tokenize the inputs. vocab_size in config file for XLM-R model is 250002 and for Roberta it is 50265. But while training I am getting below error. Can anyone help me to solve this?

I am using google colab GPU for finetuning. Tensoflow version is 2.7.0. 

**InvalidArgumentError: indices[2,268] = 124030 is not in [0, 50265) [[node tf_roberta_for_sequence_classification_1/roberta/embeddings/Gather (defined at /usr/local/lib/python3.7/dist-packages/transformers/models/roberta/modeling_tf_roberta.py:149) ]] [Op:__inference_train_function_82886]

Errors may have originated from an input operation. Input Source operations connected to node tf_roberta_for_sequence_classification_1/roberta/embeddings/Gather: In[0] tf_roberta_for_sequence_classification_1/roberta/embeddings/Gather/resource:
In[1] IteratorGetNext (defined at /usr/local/lib/python3.7/dist-packages/keras/engine/training.py:866)**
Hi @Komalrathod55 👋  Can you share the entire script (or give me a link to your colab), so I can have the entire context to check your issue? Thank you :) <|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.