Thanks for the reply.
Actually we switched from torch.cuda.amp to apex due to some internal reasons.
I studied the doc for apex, but found no instruction on this aspect. Could you please provide some suggestions regarding the above issue? Thanks!