MT5 release Collection The MT5 release follows the T5 family, but is pretrained on multilingual data. The update UMT5 models are pretrained on an updated corpus. β’ 10 items β’ Updated Dec 13, 2024 β’ 19
OpenCulture Collection A multilingual dataset of public domain books and newspapers. β’ 27 items β’ Updated Nov 6, 2024 β’ 123
Adding NVMe SSDs to Enable and Accelerate 100B Model Fine-tuning on a Single GPU Paper β’ 2403.06504 β’ Published Mar 11, 2024 β’ 53