enterthevoidf22:

ok! seems like the entire drama was solved by changing the Relu at the end of the network to LeakyRelu.


That most likely means that your input + weights were generating an output that was all negative. And so you were in the flat part of the relu for all elements and so all the gradients were 0.
The leaky relu has no flat region hence avoiding this issue.