The error is unfortunately too generic to indicate the root cause. A few sanity checks:

What command did you use to install the pytorch 1.8 binaries?
Are you ensuring that each rank in your distributed model is being assigned to a different device ID?