detectron2 is also seeing an increasing number of CUDA error reports on CUDA>=11.1 + pytorch 1.8.x + RTX30xx: RuntimeError: CUDA error: device-side assert triggered · Issue #2837 · facebookresearch/detectron2 · GitHub 32
Root cause seems to be still randperm: CUDA error: device-side assert triggered(torch1.8.1+cuda11.1) · Issue #55027 · pytorch/pytorch · GitHub 32