Lora, Low Rank Adaptation, Generative Ai, Llm, Fine Tuning.
get new weights. And we keep doing it till we are satisfied with the result (i.e., errors are low enough). It is very similar to the feedback loop in any Control System. Below is how a single fine-tuning step looks like, where h = W’x. Figure 1. Simplistic representation of fine-tuning We can also