awentzonline commited on
Commit
2ee02d4
·
verified ·
1 Parent(s): 59154a7

Model save

Browse files
README.md CHANGED
@@ -1,6 +1,5 @@
1
  ---
2
  base_model: Qwen/Qwen2.5-0.5B
3
- datasets: reply_likes.json
4
  library_name: transformers
5
  model_name: Qwen2.5-0.5B-replies
6
  tags:
@@ -12,7 +11,7 @@ licence: license
12
 
13
  # Model Card for Qwen2.5-0.5B-replies
14
 
15
- This model is a fine-tuned version of [Qwen/Qwen2.5-0.5B](https://huggingface.co/Qwen/Qwen2.5-0.5B) on the [reply_likes.json](https://huggingface.co/datasets/reply_likes.json) dataset.
16
  It has been trained using [TRL](https://github.com/huggingface/trl).
17
 
18
  ## Quick start
@@ -28,7 +27,7 @@ print(output["generated_text"])
28
 
29
  ## Training procedure
30
 
31
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/awentzonline/huggingface/runs/t99wvz8x)
32
 
33
 
34
  This model was trained with SFT.
 
1
  ---
2
  base_model: Qwen/Qwen2.5-0.5B
 
3
  library_name: transformers
4
  model_name: Qwen2.5-0.5B-replies
5
  tags:
 
11
 
12
  # Model Card for Qwen2.5-0.5B-replies
13
 
14
+ This model is a fine-tuned version of [Qwen/Qwen2.5-0.5B](https://huggingface.co/Qwen/Qwen2.5-0.5B).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
 
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/awentzonline/huggingface/runs/oas4fr8a)
31
 
32
 
33
  This model was trained with SFT.
config.json CHANGED
@@ -21,7 +21,7 @@
21
  "rope_theta": 1000000.0,
22
  "sliding_window": null,
23
  "tie_word_embeddings": true,
24
- "torch_dtype": "float32",
25
  "transformers_version": "4.48.2",
26
  "use_cache": true,
27
  "use_mrope": false,
 
21
  "rope_theta": 1000000.0,
22
  "sliding_window": null,
23
  "tie_word_embeddings": true,
24
+ "torch_dtype": "bfloat16",
25
  "transformers_version": "4.48.2",
26
  "use_cache": true,
27
  "use_mrope": false,
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:304a8fa6054442a3e7af424c91613a1c73b08a65f82caafda99d472c7f0d5c05
3
- size 1976163472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ba052fc542e0236b976425272937bb3f1a6d50937e67e3da14792f75935fee7
3
+ size 988097824
runs/Feb07_13-07-22_deeplarry/events.out.tfevents.1738962445.deeplarry.8316.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35fab35a617801eca4d2ded644e2a4ea3e7cade2a6c151fa2724f69a95f44931
3
+ size 8727
runs/Feb07_13-08-49_deeplarry/events.out.tfevents.1738962531.deeplarry.8432.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a25b63eb5c3f469cf087cd162798ef069f0bd55b930b080df308967d57d9a6f
3
+ size 562525
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ae8c64f391d64d155eea0907ab4478978a55f5a75f19a0df41a5625018177840
3
  size 5752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af35b601c0d929cfd3fb964efbf5f814ffefe1c8e666982f6a5186f9c8ebd7f0
3
  size 5752