I’m not sure at this point, how to interpret the loss curves.
The blue (good) curve looks like the x-axis is sampled differently.
Especially at the beginning it looks like the step size is not constant and you have some interpolated lines.
Are you using the same step size (e.g. wall time, iterations)?
Also, does the y-axis have the same range in all plots? If the blue line had some really high loss at the beginning, the rest might look smoother as it’s just smaller.