Could you post the complete RuntimeError?
We also recommend to use the native mixed-precision training support via torch.cuda.amp, which is available in the nightly binaries and current master, if it’s an option to update.