Hey Laurb,
Sorry I know this is an old post, but did you manage to resolve this? I’ve got the same issue when using DistilBert using custom dataset as in their tutorial. 
ValueError: Expected input batch_size (16) to match target batch_size (2848).