Yes sir, I am using sigmoid as my last non-linearity. I have been trying to restart everything from scratch so as to see whether I could find where I did wrong. I am still on it.
Really appreciate your help and time