Thanks a lot! Can torch.cuda.amp.autocast be used to change the model dtype for inference? We want to convert some the layer weights and export the model to Onnx later, so wonder if there is a way to change the model weights instead of just using amp for inference.
After reading this, my understanding is that apex.amp can be used to convert some model weights to fp16 and generate a new model, while torch.cuda.amp.autocast cannot?