Yangmin:

Is NVIDIA apex an older tool to use mixed training?


Yes, apex.amp was our first implementation of mixed-precision training, is deprecated now, and replaced with torch.cuda.amp. @seungjun posted the examples above to see its usage.



 Yangmin:

How do I use it and what is nightly builds you commented above?


You don’t need to install a nightly release anymore, as torch.cuda.amp is available in the stable releases already.