Solved by ptrblck in post #6 
              
              
                If you want to apply the norm using float16 values and are sure that you won’t run into numerical issues, you could disable autocast for this operation and manually cast it to the desired type (you can use nested autocast decorators).