End of training

README.md

@@ -0,0 +1,72 @@
+---
+library_name: transformers
+license: mit
+base_model: gpt2-medium
+tags:
+- generated_from_trainer
+model-index:
+- name: chessgpt2-medium-s
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# chessgpt2-medium-s
+
+This model is a fine-tuned version of [gpt2-medium](https://huggingface.co/gpt2-medium) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.0790
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 32
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 2
+- total_train_batch_size: 64
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: cosine
+- lr_scheduler_warmup_ratio: 0.025
+- num_epochs: 3
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch  | Step  | Validation Loss |
+|:-------------:|:------:|:-----:|:---------------:|
+| 2.3553        | 0.2560 | 1000  | 1.7539          |
+| 1.6483        | 0.5119 | 2000  | 1.4751          |
+| 1.4597        | 0.7679 | 3000  | 1.3417          |
+| 1.3504        | 1.0238 | 4000  | 1.2587          |
+| 1.2717        | 1.2798 | 5000  | 1.2104          |
+| 1.2263        | 1.5357 | 6000  | 1.1654          |
+| 1.1899        | 1.7917 | 7000  | 1.1346          |
+| 1.154         | 2.0476 | 8000  | 1.1105          |
+| 1.1124        | 2.3036 | 9000  | 1.0941          |
+| 1.1002        | 2.5595 | 10000 | 1.0835          |
+| 1.093         | 2.8155 | 11000 | 1.0790          |
+
+
+### Framework versions
+
+- Transformers 4.44.2
+- Pytorch 2.4.1+cu121
+- Datasets 3.0.1
+- Tokenizers 0.19.1

all_results.json

@@ -0,0 +1,15 @@
+{
+    "epoch": 3.0,
+    "eval_loss": 1.0790187120437622,
+    "eval_runtime": 300.3896,
+    "eval_samples": 22063,
+    "eval_samples_per_second": 73.448,
+    "eval_steps_per_second": 9.181,
+    "perplexity": 2.941791389777784,
+    "total_flos": 4.61198337106772e+17,
+    "train_loss": 1.3434544682004388,
+    "train_runtime": 53992.4682,
+    "train_samples": 250048,
+    "train_samples_per_second": 13.893,
+    "train_steps_per_second": 0.217
+}

eval_results.json

@@ -0,0 +1,9 @@
+{
+    "epoch": 3.0,
+    "eval_loss": 1.0790187120437622,
+    "eval_runtime": 300.3896,
+    "eval_samples": 22063,
+    "eval_samples_per_second": 73.448,
+    "eval_steps_per_second": 9.181,
+    "perplexity": 2.941791389777784
+}

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 0,
+  "eos_token_id": 1,
+  "transformers_version": "4.44.2"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1b4997a77b9f4ca410d176c2cc3070346dcfbb269eb015b8da3a212c27591c69
+oid sha256:be280c58eb0f28a12cc4aadd15c573a3d04b576a6f77cd971df921315f510e42
 size 1212421632

train_results.json

@@ -0,0 +1,9 @@
+{
+    "epoch": 3.0,
+    "total_flos": 4.61198337106772e+17,
+    "train_loss": 1.3434544682004388,
+    "train_runtime": 53992.4682,
+    "train_samples": 250048,
+    "train_samples_per_second": 13.893,
+    "train_steps_per_second": 0.217
+}