Hi,
I am running a seq2seq model, but it is quickly out of memory. I checked some related questions, some suggested to detech the hidden state. I want to ask if this way can affect calculation of NLL loss and BP. Or is there any way to help alleviate memory usage?