Do you suspect the accuracy calculation to be wrong or is the loss also not decreasing using amp?
In the latter case, could you check the target calculation and see, if the expected values are calculated? If not, could you move the target calculation outside of the autocast region and recheck it?
Also, what kind of model are you using at the moment and I assume the training was working fine without amp?