You are right. Memory seems to be not enough. I am actually working with speech audio data (MFCC features) so the input to the gru has a shape of [128 * 1500(aprx) * 20], 128:-batch size, 1500- sequence length in time, 20:- feature vector size. the corresponding audio files are anywhere from 2-10 seconds. This shape is actually huge for the GRU. I tried batch size of 1, and it still crashes. Any idea about a solution?