Hi,
I am using a text dataset which has some really long documents and so fitting one such input on a single machine runs into OOM error.
Any suggestions on how to break the input across multiple GPUs and also efficiently do the backward pass?
Thanks!