No theories for why this is happening and/or solutions?  I think it’s weird that it continues with memory entirely unchnaged, for like ~170 batches, and then sudddenly Bam! oom
The code is here by the way: https://github.com/hughperkins/rationalizing-neural-predictions/tree/30edf139f2c6d89b99fb97dfaf82d1b44c5bfd57 24