Hi @ptrblck thanks, yes gpu usage is right about 10.4 GB out of 11 GB with the working setup I run, and so it definitely makes sense for it to OOM if I increase the batch/truncation length just a little bit larger.
Thanks for confirming that it is a reasonable hypothesis!