autocast could apply the transformations to FP16 tensors internally and would thus work on a clone of the data (in another data type) and would save you from the error.
Generally, if Autocast isn’t raising an error, your operations should work fine.