I don’t think it’s an OOM issue.
Could you try to create a new virtual (conda) environment and reinstall the binaries?
I’ll try to reproduce this issue on an RTX 8000.
EDIT:
No reproduction on a machine with two RTX 8000 using PyTorch master built with CUDA10.2 and nightly binaries with 10.1.