malisit:

My data loader basically normalizes it by dividing each measurement by the maximum_value/2.


Try removing that, dropout, second rnn layers, gradient clipping. Try adam/adadelta + lr_scheduler.