h56cho:

attention_mask


yes, in my case I passed a list and then pass list to the inputs:

inputs = tokenizer.encode_plus(example.text_a, example.text_b, add_special_tokens=True, max_length=max_length, pad_to_max_length=True)
    input_ids , attention_mask = inputs["input_ids"] , inputs["attention_mask"]


not sure if that is the issue with yours work,
can you please let me know what is yours batch size and which environment is better for such model, I am using a tiny dataset otherwise it crashes the google colab pro,