I’m having all sorts of issues training transformers on my 3090 - this card requires the cuda 11.1 which in turn requires torch 1.7.1
Is this supported? I’m using python 3.7 (I tried 3.9 but there’s no wheel for one of the dependencies for datasets and it wouldn’t build so I rolled back).
I installed pip install torch==1.7.1+cu110  -f https://download.pytorch.org/whl/torch_stable.html
Training of RobertaForMaskedLM frequently crashes with CUDA exceptions. If this should work I’ll create specific issues.