End of training

README.md

@@ -1,20 +1,20 @@
 ---
 library_name: peft
 license: llama3.2
-base_model: meta-llama/Llama-3.2-1B-Instruct
+base_model: meta-llama/Llama-3.2-1B
 tags:
 - generated_from_trainer
 model-index:
-- name: llama-3.2-1b-airoboros-merged
+- name: llama-3.2-1B-airoboros-merged-qlora
   results: []
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-# llama-3.2-1b-airoboros-merged
+# llama-3.2-1B-airoboros-merged-qlora
 
-This model is a fine-tuned version of [meta-llama/Llama-3.2-1B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct) on the None dataset.
+This model is a fine-tuned version of [meta-llama/Llama-3.2-1B](https://huggingface.co/meta-llama/Llama-3.2-1B) on the None dataset.
 
 ## Model description
 
@@ -42,7 +42,7 @@ The following hyperparameters were used during training:
 - optimizer: Use OptimizerNames.PAGED_ADAMW_8BIT with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 5
-- num_epochs: 1
+- training_steps: 2000
 
 ### Training results