Hugging Face's logo

habanoz
/
TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-2.2epochs-oasst1-top1-instruct-V1

Text Generation
Transformers
Safetensors
English
llama
Eval Results
text-generation-inference
Model card Files Community
1
habanoz commited on
Commit
8821197
·
1 Parent(s): 5db112c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -7,4 +7,9 @@ language:
7
  pipeline_tag: text-generation
8
  ---
9
 
10
- TinyLlama-1.1B-intermediate-step-715k-1.5T finetuned using OpenAssistant/oasst_top1_2023-08-25 dataset. Qlora is used. Adapter is merged.
 
 
 
 
 
 
7
  pipeline_tag: text-generation
8
  ---
9
 
10
+ TinyLlama-1.1B-intermediate-step-715k-1.5T finetuned using OpenAssistant/oasst_top1_2023-08-25 dataset.
11
+
12
+ Qlora is used. Adapter is merged.
13
+
14
+ SFT code:
15
+ https://github.com/habanoz/qlora.git