EdBerg commited on
Commit
ec18102
·
verified ·
1 Parent(s): 446c652

End of training

Browse files
Files changed (3) hide show
  1. README.md +45 -14
  2. generation_config.json +8 -0
  3. tokenizer.json +11 -2
README.md CHANGED
@@ -1,22 +1,53 @@
1
  ---
 
 
2
  base_model: unsloth/mistral-7b-v0.3-bnb-4bit
3
  tags:
4
- - text-generation-inference
5
- - transformers
6
- - unsloth
7
- - mistral
8
- - trl
9
- license: apache-2.0
10
- language:
11
- - en
12
  ---
13
 
14
- # Uploaded model
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
 
16
- - **Developed by:** EdBerg
17
- - **License:** apache-2.0
18
- - **Finetuned from model :** unsloth/mistral-7b-v0.3-bnb-4bit
19
 
20
- This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
1
  ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
  base_model: unsloth/mistral-7b-v0.3-bnb-4bit
5
  tags:
6
+ - generated_from_trainer
7
+ model-index:
8
+ - name: arabic_trained_model_mistral7b_completion
9
+ results: []
 
 
 
 
10
  ---
11
 
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # arabic_trained_model_mistral7b_completion
16
+
17
+ This model is a fine-tuned version of [unsloth/mistral-7b-v0.3-bnb-4bit](https://huggingface.co/unsloth/mistral-7b-v0.3-bnb-4bit) on an unknown dataset.
18
+
19
+ ## Model description
20
+
21
+ More information needed
22
+
23
+ ## Intended uses & limitations
24
+
25
+ More information needed
26
+
27
+ ## Training and evaluation data
28
+
29
+ More information needed
30
+
31
+ ## Training procedure
32
+
33
+ ### Training hyperparameters
34
+
35
+ The following hyperparameters were used during training:
36
+ - learning_rate: 5e-05
37
+ - train_batch_size: 2
38
+ - eval_batch_size: 8
39
+ - seed: 42
40
+ - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
41
+ - lr_scheduler_type: linear
42
+ - num_epochs: 20
43
+
44
+ ### Training results
45
+
46
 
 
 
 
47
 
48
+ ### Framework versions
49
 
50
+ - Transformers 4.51.3
51
+ - Pytorch 2.6.0+cu124
52
+ - Datasets 3.5.0
53
+ - Tokenizers 0.21.1
generation_config.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 1,
4
+ "eos_token_id": 2,
5
+ "max_length": 32768,
6
+ "pad_token_id": 770,
7
+ "transformers_version": "4.51.3"
8
+ }
tokenizer.json CHANGED
@@ -2,11 +2,20 @@
2
  "version": "1.0",
3
  "truncation": {
4
  "direction": "Right",
5
- "max_length": 1024,
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },
9
- "padding": null,
 
 
 
 
 
 
 
 
 
10
  "added_tokens": [
11
  {
12
  "id": 0,
 
2
  "version": "1.0",
3
  "truncation": {
4
  "direction": "Right",
5
+ "max_length": 128,
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },
9
+ "padding": {
10
+ "strategy": {
11
+ "Fixed": 128
12
+ },
13
+ "direction": "Right",
14
+ "pad_to_multiple_of": null,
15
+ "pad_id": 770,
16
+ "pad_type_id": 0,
17
+ "pad_token": "[control_768]"
18
+ },
19
  "added_tokens": [
20
  {
21
  "id": 0,