Hi @tom
unfortunately, “gc.collect()” didn’t fix the leak in my program. It takes less RAM in the 3rd epoch, but it is still around 45G.
I will look into it again.
I think in your test code here https://gist.github.com/t-vi/60515a24e1cbc4dc87897a6d8c224698 15
The uni-LSTM is also leaking memory, but the leak is much smaller than bi-LSTMs