Hi,
Given your loss, I guess it is expected that the curve does not look good right? It would. only look like your first image if the loss goes to 0 right?
Maybe your model is not expressive enough? Have you checked?