Lora, Low Rank Adaptation, Generative Ai, Llm, Fine Tuning.
decompositions to slash the costs of training large language models. It adapts only low-rank factors instead of entire weight matrices, achieving major memory and performance wins. Please feel free to refer to the original paper, but if you need an explanation easier to visualize and comprehend,