Nan-Do
/

python-assistant-3b

Text Generation

text-generation-inference

Model card Files Files and versions

Nan-Do commited on Aug 4, 2023

Commit

5c362d8

·

1 Parent(s): c5be8a5

Update README.md

Updated the training method

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -10,7 +10,7 @@ tags:
 This is proof of concept to see how far LLM's on the smaller side can go when fine-tuned for code generation and understanding.
-The base model is based on OpenLlama-3b and can be found [here](https://huggingface.co/psmathur/orca_mini_3b) and it has been trained using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl/tree/main).
 Unlike the base model the prompt is based on Alapaca.
 Next there are some examples to show what the model is currently capable of.

 This is proof of concept to see how far LLM's on the smaller side can go when fine-tuned for code generation and understanding.
+The base model is based on OpenLlama-3b and can be found [here](https://huggingface.co/psmathur/orca_mini_3b) and it has been fine-tuned with LoRA using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl/tree/main).
 Unlike the base model the prompt is based on Alapaca.
 Next there are some examples to show what the model is currently capable of.