Hi Frank,
Thanks for the reply, I removed the softmax layer, but the issue still persists. The error is still not decreasing. Eventhough the weights are being updated the accuarcy of the model remains the same.