That’s probably what happened to my model too, except I did not check that carefully for bias values but I do notice bias getting dominant in terms of scale with regard to weights. The outputs are also indeed the mean.
I solved this by 1) normalizing the input by demean and divide by std and 2) used a smaller learning rate.
Thanks for the prompt reply!