Solved by albanD in post #2 
              
              
                Hi, 
It does convert everything to float16 which indeed is not optimal in most cases. 
The nvidia folks have done a lot of testing around this and release the AMP library to automatically only convert the right part of the model to fp16 !