Thanks for replying. I understand the reasoning behind what you suggest and can’t believe that I did this mistake. I did the fix for this but still the outputs seem to be similar to what I had before. I also tried various other networks I’ve found on Github that seems to be working just fine with random sine waves. With other networks, I’ve similar results as well which didn’t got me anywhere because my dataset is pretty straightforward the most basic dataset. Still there’s something in my dataset that causes the network/optimization configurations can’t grasp. I’m open to any suggestions on that end.