Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning
Paper
•
2408.14158
•
Published
•
3
Mother of all Training Clusters
https://github.com/NousResearch/DisTrO/blob/main/A_Preliminary_Report_on_DisTrO.pdf