Henry_Chibueze:

I tried reducing the batch size from 600 to 50 and something strange and interesting happened.
The mean_batch_loss increased to hundreds.


Does 600 have some meaning with respect to your input? E.g.: there are 60 samples per second, and the waveform switches signs every 10 seconds, or some such? This could explain a lot of the observed behaviour.