This might be expected, as a high learning rate wouldn’t allow the model to converge and the loss would get stuck at a particular level.
The first figure in e.g. this post 4 is often used to illustrate this behavior.