@ptrblck I posted some code, I hope it may help in this discussion.
As mentioned before, I have constant training loss, constant validation loss and constant output prediction (it’s a regression problem). Maybe it’s a dying ReLU problem, but in Keras it doesn’t happen