In that case, I would remove some layers and start with a really simple baseline model (e.g. just using two layers).
If the training loss still doesn’t change at all, some other bug might be in your training procedure.
However, if the loss moves down, you can try to scale up the model layer by layer.