Okay, then you can try increasing the layers in the neural network.
Also, just take one mini-batch and keep on using the same mini-batch and see if the loss really goes to zero or accuracy approaches 100%.
That’s one way to debug your network.