I just have one issue I have seen, which I posted here:

  
    
    
    Torch.cuda.amp and Accuracy 
  
  
    I converted my training loop to use AMP, and I notice my accuracy numbers are now all 0.  What needs to be changed to work with AMP? z was calculated within a with_autocast(): clause so I thought it should be fine, but apparently it is not. 
        print("Training..............................\r", end='') 
        train_iter = iter(train_loader)
        next_batch = train_iter.next()
        next_batch = [_.cuda(non_blocking=True) for _ in next_batch ]
        for idx in range(len(train_loader)…