Can you print out one or two examples of small_train_dataset?
In that way, you can verify whether the data is prepared correctly for the model. You can for example decode the input_ids back to text, verify the labels, etc.