Deep Learning, Artificial Intelligence, Llm, NLP, Language Model.
negligible extra computational costs and no new sources of data. U-PaLM model family of 8B, 62B, and 540B scales, is established by training PaLM with UL2R. An approximately 2× computational savings rate is achieved. Later, U-PaLM is further instruction-finetuned as Flan-U-PaLM. Outline UL2Restore