It is. Thank you. Btw, If I want to run LSTM on a quite long sequence of data with relatively high dimension, could pytorch handle GPU memory well? Because to my understanding autograd  records all action through forward and backward and pytorch process all data as batch. So I am afraid of out of memory error.