Hugging Face's logo

phonemetransformers
/
debug-gpt2_feature_lm-model

Transformers
Safetensors
gpt2
French
Generated from Trainer
text-generation-inference
Model card Files Community
codebyzeb commited on
Commit
bf2cdc2
·
verified ·
1 Parent(s): 5805a3e

Final model for experiment French

Browse files
Files changed (2) hide show
  1. README.md +134 -0
  2. generation_config.json +6 -0
README.md ADDED
@@ -0,0 +1,134 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags:
4
+ - French
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: debug-gpt2_feature_lm-model
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # debug-gpt2_feature_lm-model
15
+
16
+ This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.0055
19
+ - Model Preparation Time: 0.0047
20
+ - Perplexity: 1.0055
21
+ - Bpc: 0.0079
22
+ - Spike Seg Type Fscore Entropy: 0.1083
23
+ - Spike Seg Boundary Fscore Entropy: 0.0
24
+ - Absolute Seg Type Fscore Entropy: 0.1083
25
+ - Absolute Seg Boundary Fscore Entropy: 0.0
26
+ - Spike Seg Type Fscore Increase in entropy: 0.1083
27
+ - Spike Seg Boundary Fscore Increase in entropy: 0.0
28
+ - Absolute Seg Type Fscore Increase in entropy: 0.1083
29
+ - Absolute Seg Boundary Fscore Increase in entropy: 0.0
30
+ - Spike Seg Type Fscore Loss: 0.1083
31
+ - Spike Seg Boundary Fscore Loss: 0.0
32
+ - Absolute Seg Type Fscore Loss: 0.1083
33
+ - Absolute Seg Boundary Fscore Loss: 0.0
34
+ - Spike Seg Type Fscore Increase in loss: 0.1083
35
+ - Spike Seg Boundary Fscore Increase in loss: 0.0
36
+ - Absolute Seg Type Fscore Increase in loss: 0.1083
37
+ - Absolute Seg Boundary Fscore Increase in loss: 0.0
38
+ - Spike Seg Type Fscore Rank: 0.1617
39
+ - Spike Seg Boundary Fscore Rank: 0.3735
40
+ - Absolute Seg Type Fscore Rank: 0.0969
41
+ - Absolute Seg Boundary Fscore Rank: 0.4885
42
+ - Spike Seg Type Fscore Increase in rank: 0.1837
43
+ - Spike Seg Boundary Fscore Increase in rank: 0.4076
44
+ - Absolute Seg Type Fscore Increase in rank: 0.0829
45
+ - Absolute Seg Boundary Fscore Increase in rank: 0.4769
46
+ - Spike Seg Type Fscore Boundary prediction: 0.1083
47
+ - Spike Seg Boundary Fscore Boundary prediction: 0.0
48
+ - Absolute Seg Type Fscore Boundary prediction: 0.1083
49
+ - Absolute Seg Boundary Fscore Boundary prediction: 0.0
50
+ - Spike Seg Type Fscore Increase in boundary prediction: 0.1083
51
+ - Spike Seg Boundary Fscore Increase in boundary prediction: 0.0
52
+ - Absolute Seg Type Fscore Increase in boundary prediction: 0.1083
53
+ - Absolute Seg Boundary Fscore Increase in boundary prediction: 0.0
54
+ - Spike Seg Type Fscore Feature loss: 0.2134
55
+ - Spike Seg Boundary Fscore Feature loss: 0.3550
56
+ - Absolute Seg Type Fscore Feature loss: 0.2331
57
+ - Absolute Seg Boundary Fscore Feature loss: 0.4241
58
+ - Spike Seg Type Fscore Increase in feature loss: 0.2278
59
+ - Spike Seg Boundary Fscore Increase in feature loss: 0.3565
60
+ - Absolute Seg Type Fscore Increase in feature loss: 0.2064
61
+ - Absolute Seg Boundary Fscore Increase in feature loss: 0.4479
62
+ - Spike Seg Type Fscore Feature entropy: 0.2156
63
+ - Spike Seg Boundary Fscore Feature entropy: 0.3552
64
+ - Absolute Seg Type Fscore Feature entropy: 0.2331
65
+ - Absolute Seg Boundary Fscore Feature entropy: 0.4241
66
+ - Spike Seg Type Fscore Increase in feature entropy: 0.2300
67
+ - Spike Seg Boundary Fscore Increase in feature entropy: 0.3568
68
+ - Absolute Seg Type Fscore Increase in feature entropy: 0.2064
69
+ - Absolute Seg Boundary Fscore Increase in feature entropy: 0.4479
70
+ - Spike Seg Type Fscore Loss deviation: 0.1787
71
+ - Spike Seg Boundary Fscore Loss deviation: 0.3051
72
+ - Absolute Seg Type Fscore Loss deviation: 0.1885
73
+ - Absolute Seg Boundary Fscore Loss deviation: 0.4627
74
+ - Spike Seg Type Fscore Increase in loss deviation: 0.1787
75
+ - Spike Seg Boundary Fscore Increase in loss deviation: 0.3051
76
+ - Absolute Seg Type Fscore Increase in loss deviation: 0.2183
77
+ - Absolute Seg Boundary Fscore Increase in loss deviation: 0.4511
78
+ - Spike Seg Type Fscore Boundary feature prediction: 0.1953
79
+ - Spike Seg Boundary Fscore Boundary feature prediction: 0.3138
80
+ - Absolute Seg Type Fscore Boundary feature prediction: 0.2003
81
+ - Absolute Seg Boundary Fscore Boundary feature prediction: 0.3883
82
+ - Spike Seg Type Fscore Increase in boundary feature prediction: 0.1953
83
+ - Spike Seg Boundary Fscore Increase in boundary feature prediction: 0.3138
84
+ - Absolute Seg Type Fscore Increase in boundary feature prediction: 0.2413
85
+ - Absolute Seg Boundary Fscore Increase in boundary feature prediction: 0.4521
86
+ - Spike Seg Type Fscore Majority vote cutoff: 0.1978
87
+ - Spike Seg Type Fscore Majority vote spike: 0.2133
88
+ - Absolute Seg Type Fscore Majority vote cutoff: 0.1921
89
+ - Absolute Seg Type Fscore Majority vote spike: 0.1083
90
+ - Spike Seg Boundary Fscore Majority vote cutoff: 0.3507
91
+ - Spike Seg Boundary Fscore Majority vote spike: 0.3368
92
+ - Absolute Seg Boundary Fscore Majority vote cutoff: 0.3543
93
+ - Absolute Seg Boundary Fscore Majority vote spike: 0.0
94
+
95
+ ## Model description
96
+
97
+ More information needed
98
+
99
+ ## Intended uses & limitations
100
+
101
+ More information needed
102
+
103
+ ## Training and evaluation data
104
+
105
+ More information needed
106
+
107
+ ## Training procedure
108
+
109
+ ### Training hyperparameters
110
+
111
+ The following hyperparameters were used during training:
112
+ - learning_rate: 0.001
113
+ - train_batch_size: 32
114
+ - eval_batch_size: 32
115
+ - seed: 42
116
+ - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
117
+ - lr_scheduler_type: linear
118
+ - lr_scheduler_warmup_steps: 10
119
+ - training_steps: 100
120
+
121
+ ### Training results
122
+
123
+ | Training Loss | Epoch | Step | Validation Loss | Model Preparation Time | Perplexity | Bpc | Spike Seg Type Fscore Entropy | Spike Seg Boundary Fscore Entropy | Absolute Seg Type Fscore Entropy | Absolute Seg Boundary Fscore Entropy | Spike Seg Type Fscore Increase in entropy | Spike Seg Boundary Fscore Increase in entropy | Absolute Seg Type Fscore Increase in entropy | Absolute Seg Boundary Fscore Increase in entropy | Spike Seg Type Fscore Loss | Spike Seg Boundary Fscore Loss | Absolute Seg Type Fscore Loss | Absolute Seg Boundary Fscore Loss | Spike Seg Type Fscore Increase in loss | Spike Seg Boundary Fscore Increase in loss | Absolute Seg Type Fscore Increase in loss | Absolute Seg Boundary Fscore Increase in loss | Spike Seg Type Fscore Rank | Spike Seg Boundary Fscore Rank | Absolute Seg Type Fscore Rank | Absolute Seg Boundary Fscore Rank | Spike Seg Type Fscore Increase in rank | Spike Seg Boundary Fscore Increase in rank | Absolute Seg Type Fscore Increase in rank | Absolute Seg Boundary Fscore Increase in rank | Spike Seg Type Fscore Boundary prediction | Spike Seg Boundary Fscore Boundary prediction | Absolute Seg Type Fscore Boundary prediction | Absolute Seg Boundary Fscore Boundary prediction | Spike Seg Type Fscore Increase in boundary prediction | Spike Seg Boundary Fscore Increase in boundary prediction | Absolute Seg Type Fscore Increase in boundary prediction | Absolute Seg Boundary Fscore Increase in boundary prediction | Spike Seg Type Fscore Feature loss | Spike Seg Boundary Fscore Feature loss | Absolute Seg Type Fscore Feature loss | Absolute Seg Boundary Fscore Feature loss | Spike Seg Type Fscore Increase in feature loss | Spike Seg Boundary Fscore Increase in feature loss | Absolute Seg Type Fscore Increase in feature loss | Absolute Seg Boundary Fscore Increase in feature loss | Spike Seg Type Fscore Feature entropy | Spike Seg Boundary Fscore Feature entropy | Absolute Seg Type Fscore Feature entropy | Absolute Seg Boundary Fscore Feature entropy | Spike Seg Type Fscore Increase in feature entropy | Spike Seg Boundary Fscore Increase in feature entropy | Absolute Seg Type Fscore Increase in feature entropy | Absolute Seg Boundary Fscore Increase in feature entropy | Spike Seg Type Fscore Loss deviation | Spike Seg Boundary Fscore Loss deviation | Absolute Seg Type Fscore Loss deviation | Absolute Seg Boundary Fscore Loss deviation | Spike Seg Type Fscore Increase in loss deviation | Spike Seg Boundary Fscore Increase in loss deviation | Absolute Seg Type Fscore Increase in loss deviation | Absolute Seg Boundary Fscore Increase in loss deviation | Spike Seg Type Fscore Boundary feature prediction | Spike Seg Boundary Fscore Boundary feature prediction | Absolute Seg Type Fscore Boundary feature prediction | Absolute Seg Boundary Fscore Boundary feature prediction | Spike Seg Type Fscore Increase in boundary feature prediction | Spike Seg Boundary Fscore Increase in boundary feature prediction | Absolute Seg Type Fscore Increase in boundary feature prediction | Absolute Seg Boundary Fscore Increase in boundary feature prediction | Spike Seg Type Fscore Majority vote cutoff | Spike Seg Type Fscore Majority vote spike | Absolute Seg Type Fscore Majority vote cutoff | Absolute Seg Type Fscore Majority vote spike | Spike Seg Boundary Fscore Majority vote cutoff | Spike Seg Boundary Fscore Majority vote spike | Absolute Seg Boundary Fscore Majority vote cutoff | Absolute Seg Boundary Fscore Majority vote spike |
124
+ |:-------------:|:------:|:----:|:---------------:|:----------------------:|:----------:|:------:|:-----------------------------:|:---------------------------------:|:--------------------------------:|:------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:------------------------------------------------:|:--------------------------:|:------------------------------:|:-----------------------------:|:---------------------------------:|:--------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------:|:------------------------------:|:-----------------------------:|:---------------------------------:|:--------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:------------------------------------------------:|:-----------------------------------------------------:|:---------------------------------------------------------:|:--------------------------------------------------------:|:------------------------------------------------------------:|:----------------------------------:|:--------------------------------------:|:-------------------------------------:|:-----------------------------------------:|:----------------------------------------------:|:--------------------------------------------------:|:-------------------------------------------------:|:-----------------------------------------------------:|:-------------------------------------:|:-----------------------------------------:|:----------------------------------------:|:--------------------------------------------:|:-------------------------------------------------:|:-----------------------------------------------------:|:----------------------------------------------------:|:--------------------------------------------------------:|:------------------------------------:|:----------------------------------------:|:---------------------------------------:|:-------------------------------------------:|:------------------------------------------------:|:----------------------------------------------------:|:---------------------------------------------------:|:-------------------------------------------------------:|:-------------------------------------------------:|:-----------------------------------------------------:|:----------------------------------------------------:|:--------------------------------------------------------:|:-------------------------------------------------------------:|:-----------------------------------------------------------------:|:----------------------------------------------------------------:|:--------------------------------------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:----------------------------------------------:|:---------------------------------------------:|:-------------------------------------------------:|:------------------------------------------------:|
125
+ | 0.009 | 1.1111 | 50 | 0.0077 | 0.0047 | 1.0078 | 0.0112 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1617 | 0.3735 | 0.0969 | 0.4885 | 0.1837 | 0.4076 | 0.0829 | 0.4769 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.2156 | 0.3552 | 0.2331 | 0.4241 | 0.2156 | 0.3552 | 0.2072 | 0.4274 | 0.2156 | 0.3552 | 0.2331 | 0.4241 | 0.2156 | 0.3552 | 0.2072 | 0.4274 | 0.1787 | 0.3051 | 0.1815 | 0.4483 | 0.1787 | 0.3051 | 0.2187 | 0.4145 | 0.1953 | 0.3138 | 0.2187 | 0.4330 | 0.1953 | 0.3138 | 0.2413 | 0.4521 | 0.2074 | 0.2105 | 0.1764 | 0.1083 | 0.3364 | 0.3464 | 0.2342 | 0.0 |
126
+ | 0.0063 | 2.2222 | 100 | 0.0055 | 0.0047 | 1.0055 | 0.0079 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1617 | 0.3735 | 0.0969 | 0.4885 | 0.1837 | 0.4076 | 0.0829 | 0.4769 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.1083 | 0.0 | 0.2134 | 0.3550 | 0.2331 | 0.4241 | 0.2278 | 0.3565 | 0.2064 | 0.4479 | 0.2156 | 0.3552 | 0.2331 | 0.4241 | 0.2300 | 0.3568 | 0.2064 | 0.4479 | 0.1787 | 0.3051 | 0.1885 | 0.4627 | 0.1787 | 0.3051 | 0.2183 | 0.4511 | 0.1953 | 0.3138 | 0.2003 | 0.3883 | 0.1953 | 0.3138 | 0.2413 | 0.4521 | 0.1978 | 0.2133 | 0.1921 | 0.1083 | 0.3507 | 0.3368 | 0.3543 | 0.0 |
127
+
128
+
129
+ ### Framework versions
130
+
131
+ - Transformers 4.48.1
132
+ - Pytorch 2.5.1
133
+ - Datasets 2.18.0
134
+ - Tokenizers 0.21.0
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 3,
4
+ "eos_token_id": 3,
5
+ "transformers_version": "4.48.1"
6
+ }