This week Amazon has set up AWS P3 instances with Tesla V100 cards, which support half-precision training, so I am awakening this old topic.
I only have experience with fp training on Titan X.  If someone has insight on how to train with half-precision on Tesla V100 or P100 cards, please share them with us!