Thanks for the detailed reply Abhilash.
Your example makes sense. Then, a follow up question is why the training loss isn’t multiply by len(data) while validation loss is?
Is there some relevant theoretical background underlying word language models that I’m missing?