Hi Huggingface team,
I am trying to fine-tune my MLM RoBERTa model on a binary classification dataset. I’m able to successfully tokenize my entire dataset, but during training, I keep getting the same CUDA memory error. I’m sure as to where the memory is taken up, but have attached the entire notebook here 26 for reference.
Error message: Screen Shot 2020-07-23 at 11.53.29 AM1630×824 181 KB
I suspect it has something to do with my train() method.
Does anyone have any thoughts on why the GPU memory is being almost entirely allocated to PyTorch? Any help is appreciated, thanks!