If you only do model.half() and then forward. Pytorch will only convert all the model weights to half precision and then forward with that.
If you want something smarter (that keeps single precision buffers for some ops for stability), you can check out nvidia’s amp package 327.