Llm, AI, Data Science, Machine Learning, Programming.
to the model while keeping the original model parameters frozen. Why LoRA? source Even though we’re adding more layers to the model with LoRA, it actually helps save memory. This is because the smaller layers (A and B) have fewer parameters to learn compared to the big model and fewer trainable