AMP will autocast operators as described in this list 5. Since spectral_norm uses some of them (e.g. matmul) this operation would be performed in FP16. If you want to keep the calculation in FP32, you can disable autocast for this call.