That’s normal while training. This is because your training loss is averaging every batch loss between the epoch beginning and end. But your validation loss is only calculated after that epoch has already finished. So the validation will always show a slight advantage if the network improved during that epoch.