torch.cuda.amp.autocast() uses an internal mapping of operations, which have to use FP32 for numerical stability as descrbed here 6. If your model works fine (and the accuracy doesn’t decrease), I don’t see an argument against using model.half().
No, I wouldn’t expect autocast to be faster.