Seems to be more about size of text input to the model than size of file in terms of physical size or number of rows. When I use files with number of input (text) tokens = 400 t5-large blows, but with 200 it doesn’t, regardless of length of file (number of samples).
So given that I am near the limit of GPU memory then maybe staying at 200 text tokens below means that I don’t breach the memory limit because the model is (a tiny bit) smaller?