I just tried both SGD and Adam with a learnign rates from 0.000001 to 0.1 and the problem persisted. I was going to post output in this reply but preferred editing the original post. Please check it again.