Paladiso commited on
Commit
eccff4c
·
verified ·
1 Parent(s): 40bfd20

End of training

Browse files
Files changed (1) hide show
  1. README.md +17 -17
README.md CHANGED
@@ -1,13 +1,14 @@
1
  ---
2
  library_name: peft
3
- base_model: lmsys/vicuna-7b-v1.3
 
4
  tags:
5
  - axolotl
6
  - generated_from_trainer
7
  datasets:
8
- - Paladiso/dataset_a6d9ee3a-6e70-4ab7-9e9f-80087a260018
9
  model-index:
10
- - name: 411f1091-665a-4792-97eb-4d4e7b8ff915
11
  results: []
12
  ---
13
 
@@ -20,18 +21,17 @@ should probably proofread and complete it, then remove this comment. -->
20
  axolotl version: `0.6.0`
21
  ```yaml
22
  adapter: lora
23
- base_model: lmsys/vicuna-7b-v1.3
24
  bf16: auto
25
  chat_template: llama3
26
  dataset_prepared_path: /workspace/axolotl/data/prepared
27
  datasets:
28
  - ds_type: json
29
  format: custom
30
- path: Paladiso/dataset_a6d9ee3a-6e70-4ab7-9e9f-80087a260018
31
  type:
32
- field_input: CV
33
- field_instruction: Job Description
34
- field_output: feedback
35
  system_format: '{system}'
36
  system_prompt: ''
37
  debug: null
@@ -47,7 +47,7 @@ fsdp_config: null
47
  gradient_accumulation_steps: 4
48
  gradient_checkpointing: false
49
  group_by_length: false
50
- hub_model_id: Paladiso/411f1091-665a-4792-97eb-4d4e7b8ff915
51
  hub_private_repo: true
52
  hub_repo: null
53
  hub_strategy: checkpoint
@@ -87,10 +87,10 @@ use_accelerate: true
87
  val_set_size: 0.05
88
  wandb_entity: null
89
  wandb_mode: online
90
- wandb_name: a6d9ee3a-6e70-4ab7-9e9f-80087a260018
91
  wandb_project: Gradients-On-Demand
92
  wandb_run: your_name
93
- wandb_runid: a6d9ee3a-6e70-4ab7-9e9f-80087a260018
94
  warmup_steps: 10
95
  weight_decay: 0.0
96
  xformers_attention: null
@@ -99,11 +99,11 @@ xformers_attention: null
99
 
100
  </details><br>
101
 
102
- # 411f1091-665a-4792-97eb-4d4e7b8ff915
103
 
104
- This model is a fine-tuned version of [lmsys/vicuna-7b-v1.3](https://huggingface.co/lmsys/vicuna-7b-v1.3) on the Paladiso/dataset_a6d9ee3a-6e70-4ab7-9e9f-80087a260018 dataset.
105
  It achieves the following results on the evaluation set:
106
- - Loss: 2.1452
107
 
108
  ## Model description
109
 
@@ -137,9 +137,9 @@ The following hyperparameters were used during training:
137
 
138
  | Training Loss | Epoch | Step | Validation Loss |
139
  |:-------------:|:------:|:----:|:---------------:|
140
- | 2.3978 | 0.0010 | 3 | 2.5506 |
141
- | 2.5566 | 0.0021 | 6 | 2.4761 |
142
- | 2.6659 | 0.0031 | 9 | 2.1452 |
143
 
144
 
145
  ### Framework versions
 
1
  ---
2
  library_name: peft
3
+ license: apache-2.0
4
+ base_model: unsloth/Qwen2.5-1.5B
5
  tags:
6
  - axolotl
7
  - generated_from_trainer
8
  datasets:
9
+ - Paladiso/dataset_7fc40eed-6bc5-4668-b817-a908f0a659fe
10
  model-index:
11
+ - name: e2729802-dde6-43c2-bb4a-4d0a4beac90e
12
  results: []
13
  ---
14
 
 
21
  axolotl version: `0.6.0`
22
  ```yaml
23
  adapter: lora
24
+ base_model: unsloth/Qwen2.5-1.5B
25
  bf16: auto
26
  chat_template: llama3
27
  dataset_prepared_path: /workspace/axolotl/data/prepared
28
  datasets:
29
  - ds_type: json
30
  format: custom
31
+ path: Paladiso/dataset_7fc40eed-6bc5-4668-b817-a908f0a659fe
32
  type:
33
+ field_instruction: abstract
34
+ field_output: title
 
35
  system_format: '{system}'
36
  system_prompt: ''
37
  debug: null
 
47
  gradient_accumulation_steps: 4
48
  gradient_checkpointing: false
49
  group_by_length: false
50
+ hub_model_id: Paladiso/e2729802-dde6-43c2-bb4a-4d0a4beac90e
51
  hub_private_repo: true
52
  hub_repo: null
53
  hub_strategy: checkpoint
 
87
  val_set_size: 0.05
88
  wandb_entity: null
89
  wandb_mode: online
90
+ wandb_name: 7fc40eed-6bc5-4668-b817-a908f0a659fe
91
  wandb_project: Gradients-On-Demand
92
  wandb_run: your_name
93
+ wandb_runid: 7fc40eed-6bc5-4668-b817-a908f0a659fe
94
  warmup_steps: 10
95
  weight_decay: 0.0
96
  xformers_attention: null
 
99
 
100
  </details><br>
101
 
102
+ # e2729802-dde6-43c2-bb4a-4d0a4beac90e
103
 
104
+ This model is a fine-tuned version of [unsloth/Qwen2.5-1.5B](https://huggingface.co/unsloth/Qwen2.5-1.5B) on the Paladiso/dataset_7fc40eed-6bc5-4668-b817-a908f0a659fe dataset.
105
  It achieves the following results on the evaluation set:
106
+ - Loss: 2.3707
107
 
108
  ## Model description
109
 
 
137
 
138
  | Training Loss | Epoch | Step | Validation Loss |
139
  |:-------------:|:------:|:----:|:---------------:|
140
+ | 2.327 | 0.0004 | 3 | 2.8300 |
141
+ | 2.4 | 0.0007 | 6 | 2.7118 |
142
+ | 2.8662 | 0.0011 | 9 | 2.3707 |
143
 
144
 
145
  ### Framework versions