Hugging Face's logo

shoubing35
/
gpt2-qat

Text Generation
Transformers
TensorBoard
Safetensors
gpt2
Generated from Trainer
sft
trl
text-generation-inference
Model card Files
xet
Metrics Community
shoubing35 commited on
Commit
c23d35f
·
verified ·
1 Parent(s): 84e6c96

Training in progress, step 40

Browse files
Files changed (11) hide show
  1. README.md +2 -3
  2. adapter_config.json +2 -2
  3. adapter_model.safetensors +1 -1
  4. runs/Jun25_21-44-07_8c8eb044f4d6/events.out.tfevents.1750887868.8c8eb044f4d6.8279.0 +3 -0
  5. runs/Jun25_21-52-03_8c8eb044f4d6/events.out.tfevents.1750888331.8c8eb044f4d6.10375.0 +3 -0
  6. runs/Jun25_22-03-23_8c8eb044f4d6/events.out.tfevents.1750889011.8c8eb044f4d6.13259.0 +3 -0
  7. runs/Jun25_22-06-57_8c8eb044f4d6/events.out.tfevents.1750889226.8c8eb044f4d6.14230.0 +3 -0
  8. runs/Jun25_22-10-29_8c8eb044f4d6/events.out.tfevents.1750889436.8c8eb044f4d6.15188.0 +3 -0
  9. runs/Jun25_22-17-47_8c8eb044f4d6/events.out.tfevents.1750889875.8c8eb044f4d6.17071.0 +3 -0
  10. runs/Jun25_22-20-46_8c8eb044f4d6/events.out.tfevents.1750890054.8c8eb044f4d6.17904.0 +3 -0
  11. training_args.bin +1 -1
README.md CHANGED
@@ -1,18 +1,17 @@
1
  ---
2
  base_model: openai-community/gpt2
3
- datasets: rajpurkar/squad
4
  library_name: transformers
5
  model_name: gpt2-qat
6
  tags:
7
  - generated_from_trainer
8
- - sft
9
  - trl
 
10
  licence: license
11
  ---
12
 
13
  # Model Card for gpt2-qat
14
 
15
- This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2) on the [rajpurkar/squad](https://huggingface.co/datasets/rajpurkar/squad) dataset.
16
  It has been trained using [TRL](https://github.com/huggingface/trl).
17
 
18
  ## Quick start
 
1
  ---
2
  base_model: openai-community/gpt2
 
3
  library_name: transformers
4
  model_name: gpt2-qat
5
  tags:
6
  - generated_from_trainer
 
7
  - trl
8
+ - sft
9
  licence: license
10
  ---
11
 
12
  # Model Card for gpt2-qat
13
 
14
+ This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
adapter_config.json CHANGED
@@ -26,9 +26,9 @@
26
  "rank_pattern": {},
27
  "revision": null,
28
  "target_modules": [
29
- "c_proj",
30
  "c_fc",
31
- "c_attn"
 
32
  ],
33
  "task_type": "CAUSAL_LM",
34
  "trainable_token_indices": null,
 
26
  "rank_pattern": {},
27
  "revision": null,
28
  "target_modules": [
 
29
  "c_fc",
30
+ "c_attn",
31
+ "c_proj"
32
  ],
33
  "task_type": "CAUSAL_LM",
34
  "trainable_token_indices": null,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:453265aecb95223cf8c5e3e4c6d4e951a67623bba8993be5792859c0563183f2
3
  size 9449344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65cdd8c90ea967647e31659cce3088f63d74889f9e1ba392fef048253c85fa06
3
  size 9449344
runs/Jun25_21-44-07_8c8eb044f4d6/events.out.tfevents.1750887868.8c8eb044f4d6.8279.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed5c592b5d56c4b69aed9a87076fadae72a3f915b6385fbc420ad087d1edffa9
3
+ size 5738
runs/Jun25_21-52-03_8c8eb044f4d6/events.out.tfevents.1750888331.8c8eb044f4d6.10375.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b8480da31e0ca00a3673c3df5b3569917e52674166f464e8077afc00fa0944f
3
+ size 5738
runs/Jun25_22-03-23_8c8eb044f4d6/events.out.tfevents.1750889011.8c8eb044f4d6.13259.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae69f52c1cca3b52495f8ea4322e5c0b4d1cc2d52d8490d4cc2ff12554084fd7
3
+ size 5738
runs/Jun25_22-06-57_8c8eb044f4d6/events.out.tfevents.1750889226.8c8eb044f4d6.14230.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2162ff522b2a43b70f6ece1511ea2248f9066abf6835a2590dcf7b5b56739b7
3
+ size 5738
runs/Jun25_22-10-29_8c8eb044f4d6/events.out.tfevents.1750889436.8c8eb044f4d6.15188.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79243ae46b924cf27b5362ea082f3ef0ea748313ace2110b6fa740e398aa775d
3
+ size 5738
runs/Jun25_22-17-47_8c8eb044f4d6/events.out.tfevents.1750889875.8c8eb044f4d6.17071.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eeb217e6856fb4920680d60c9ee5befde3820fd7328fffd04c0c315bea5e0bee
3
+ size 5738
runs/Jun25_22-20-46_8c8eb044f4d6/events.out.tfevents.1750890054.8c8eb044f4d6.17904.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99b3dd0c091b2c1fc7652181ea57eae832842e266f004d645c72a3e4adca73a2
3
+ size 34286
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d6d014c3fedee1ea7a6e9629cbaa184c65ea79c36c6ac62a50955dd596c7d1ed
3
  size 5752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c560c02df19c65d50efd110c0478be1ecbdd2da74571d9b886278c38e5b9007
3
  size 5752