You could skim through the release notes for each released PyTorch version and check which changes might affect your training. I would probably start with backwards compatibility breaking changes and see, if fixing these might help.


You would have to search for all CUDA 11.x related PRs and try to backport them to the older PyTorch release, which might be cumbersome depending how old the PyTorch release is (and might not be trivial at all).