Solved by ptrblck in post #2 
              
              
                Yes, you can also use autocast during the validation step and wouldn’t need to apply the gradient scaling, since no gradient are calculated in this phase.