Megatron
[GPT 3](https://texonom.com/gpt-3-a69d4bc827004e0690b36132632f46b0) 




> [Announcing Megatron for Training Trillion Parameter Models & NVIDIA Riva Availability | NVIDIA Developer Blog](https://developer.nvidia.com/blog/announcing-megatron-for-training-trillion-parameter-models-riva-availability/)














