Falcon 7b model trained on FAQ from an ecommerce website.
Tutorials
- Text tutorial: https://www.mlexpert.io/prompt-engineering/fine-tuning-llm-on-custom-dataset-with-qlora
- YouTube video: https://www.youtube.com/watch?v=DcBC4yGHV4Q
Training
Fine-tuned using the QLoRA technique (only adapter uploaded). With the help of bitsandbytes, peft and transformers. Full reproduction is available in the tutorials.
Inference API (serverless) is not available, repository is disabled.