Thanks for the information!
In that case, could you try to lower the learning rate and see if the outputs stays constant?
If that doesn’t help, you should try to overfit a small data sample (e.g. just 10 samples) and see, if your model is able to learn this sample at all.