I redid the experiment using a sample of 600 images, where each iteration where ran for 5 epochs,
here is a few samples of the output of each case, 5 experiment where done for both and with and without, and i took 2 random samples from both to display the difference. It seem to be reproducible.
with torch.cuda.amp.autocast()
image906×228 497 KB `
image906×228 308 KB
without amp:
image906×228 243 KB
image906×228 248 KB