Hi,
It does convert everything to float16 which indeed is not optimal in most cases.
The nvidia folks have done a lot of testing around this and release the AMP 6 library to automatically only convert the right part of the model to fp16 !