All  Transformers models will return the loss when fed with the inputs and labels (usually named labels). The Trainer thus expects each element of the dataset you pass to be a dictionary with all the inputs the model expects to return the loss (including those labels).