Why do you expect val to be high? The trend per epoch in the training is also steadily decreasing. So the val is decreasing too.
i had this issue before but cant remember how I solved it. You have samples in your data that are too different.

Do you normalize your data? check if you are doing some augmentations that change the data too much. I believe this was the issue I had.
try clipping the gradients?