sandernotenbaert
/

OKAI-midi-gen-v-001

text-generation

Generated from Trainer

text-generation-inference

Model card Files Files and versions

Metrics Training metrics Community

sandernotenbaert commited on Jun 13

Commit

022fbfe

·

verified ·

1 Parent(s): a7d1683

Update README.md

Files changed (1) hide show

README.md +11 -8

README.md CHANGED Viewed

@@ -50,14 +50,17 @@ More information needed
 ## Training procedure
 training_config:
-  - max_position_embeddings: 1024
-  - num_attention_heads: 4
-  - pipeline_tag: other
-  - num_hidden_layers: 4
-  - sliding_window: 4
-  - intermediate_size: 512
-  - hidden_size: 256
-  - num_key_value_heads: 4
 ### Training hyperparameters

 ## Training procedure
 training_config:
+  vocab_size: 30000
+  hidden_size: 256
+  intermediate_size: 512
+  num_hidden_layers: 4
+  num_attention_heads: 4
+  num_key_value_heads: 4
+  sliding_window: 4
+  max_position_embeddings: 1024
+  pad_token_id: 0
+  bos_token_id: 1
+  eos_token_id: 2
 ### Training hyperparameters