I wonder if the devs have any specific advices on training with half precision?
I converted my model to run with cuda().half(), but it seems to not be able to converge.
Is there something I should be aware of?
Thank you!