Solved by ptrblck in post #2 
              
              
                You could skim through the release notes for each released PyTorch version and check which changes might affect your training. I would probably start with backwards compatibility breaking changes and see, if fixing these might help. 


You would have to search for all CUDA 11.x related PRs and try…