Title: I&#x27;ve been playing around with <a href="https:&#x2F;&#x2F;github.com&#x2F;zphang&#x2F;minimal-llama&#x2F;">https:&#x2F;&#x2F;github.com&#x2F;zphang&#x2F;minimal-llama&#x2F;</a> and <a href="https:&#x2F;&#x2F;github.com&#x2F;tloen&#x2F;alpaca-lora&#x2F;blob&#x2F;main&#x2F;finetune.py">https:&#x2F;&#x2F;github.com&#x2F;tloen&#x2F;alpaca-lora&#x2F;blob&#x2F;main&#x2F;finetune.py</a>, and wanted to create a simple UI where you can just paste text, tweak the parameters, and finetune the model quickly using a modern GPU.<p>To prepare the data, simply separate your text with two blank lines.<p>There&#x27;s an inference tab, so you can test how the tuned model behaves.<p>This is my first foray into the world of LLM finetuning, Python, Torch, Transformers, LoRA, PEFT, and Gradio.<p>Enjoy!
Upvote: