Thankyou for this reply. I will go through the links you mentioned. But wanted to as one question.
We are interested in fast inference speed more than fast training. Does mixed precison using torch.cuda.amp allows faster inference also or speeds up only training?