0xcd21h commited on
Commit
5050948
·
1 Parent(s): ff1fee9

End of training

Browse files
README.md CHANGED
@@ -5,6 +5,7 @@ tags:
5
  model-index:
6
  - name: results_modified
7
  results: []
 
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -28,6 +29,17 @@ More information needed
28
 
29
  ## Training procedure
30
 
 
 
 
 
 
 
 
 
 
 
 
31
  ### Training hyperparameters
32
 
33
  The following hyperparameters were used during training:
@@ -46,6 +58,7 @@ The following hyperparameters were used during training:
46
 
47
  ### Framework versions
48
 
 
49
  - Transformers 4.31.0
50
  - Pytorch 2.0.1+cu118
51
  - Datasets 2.14.5
 
5
  model-index:
6
  - name: results_modified
7
  results: []
8
+ library_name: peft
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
29
 
30
  ## Training procedure
31
 
32
+
33
+ The following `bitsandbytes` quantization config was used during training:
34
+ - load_in_8bit: False
35
+ - load_in_4bit: True
36
+ - llm_int8_threshold: 6.0
37
+ - llm_int8_skip_modules: None
38
+ - llm_int8_enable_fp32_cpu_offload: False
39
+ - llm_int8_has_fp16_weight: False
40
+ - bnb_4bit_quant_type: nf4
41
+ - bnb_4bit_use_double_quant: False
42
+ - bnb_4bit_compute_dtype: float16
43
  ### Training hyperparameters
44
 
45
  The following hyperparameters were used during training:
 
58
 
59
  ### Framework versions
60
 
61
+ - PEFT 0.4.0
62
  - Transformers 4.31.0
63
  - Pytorch 2.0.1+cu118
64
  - Datasets 2.14.5
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fdf29b0e22f929a99f034851378b2d6962fd0013a483203d274e59c344ee9bea
3
  size 16822989
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e50a0ad3b1f3b4887b5619c37bf565d563472eb4e2adb7d66349990b5b2e897b
3
  size 16822989
runs/Oct14_17-40-42_122932c33628/events.out.tfevents.1697305258.122932c33628.16803.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f71553b72d050328706f47c1971ccc6b6036f1a402112a4c1c752d9d7c08fb57
3
+ size 4747
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6e7fe11ba830645ec469af010d56a420d9a85a93f44a1a41763e4bfc1b721a0c
3
  size 3963
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5573b97369b84b8c889cc0f891ee393b5776454cc0ba17eb7d047218cb4beb5
3
  size 3963