--- library_name: transformers tags: - French - generated_from_trainer model-index: - name: debug-gpt2_feature_lm-model results: [] --- # debug-gpt2_feature_lm-model This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 0.0053 - Model Preparation Time: 0.0047 - Perplexity: 1.0053 - Bpc: 0.0077 - Spike Seg Type Fscore Entropy: 0.1046 - Spike Seg Boundary Fscore Entropy: 0.0 - Absolute Seg Type Fscore Entropy: 0.1046 - Absolute Seg Boundary Fscore Entropy: 0.0 - Spike Seg Type Fscore Increase in entropy: 0.1046 - Spike Seg Boundary Fscore Increase in entropy: 0.0 - Absolute Seg Type Fscore Increase in entropy: 0.1046 - Absolute Seg Boundary Fscore Increase in entropy: 0.0 - Spike Seg Type Fscore Loss: 0.1046 - Spike Seg Boundary Fscore Loss: 0.0 - Absolute Seg Type Fscore Loss: 0.1046 - Absolute Seg Boundary Fscore Loss: 0.0 - Spike Seg Type Fscore Increase in loss: 0.1046 - Spike Seg Boundary Fscore Increase in loss: 0.0 - Absolute Seg Type Fscore Increase in loss: 0.1046 - Absolute Seg Boundary Fscore Increase in loss: 0.0 - Spike Seg Type Fscore Rank: 0.1127 - Spike Seg Boundary Fscore Rank: 0.2672 - Absolute Seg Type Fscore Rank: 0.1283 - Absolute Seg Boundary Fscore Rank: 0.4786 - Spike Seg Type Fscore Increase in rank: 0.1357 - Spike Seg Boundary Fscore Increase in rank: 0.3345 - Absolute Seg Type Fscore Increase in rank: 0.1048 - Absolute Seg Boundary Fscore Increase in rank: 0.4574 - Spike Seg Type Fscore Boundary prediction: 0.1046 - Spike Seg Boundary Fscore Boundary prediction: 0.0 - Absolute Seg Type Fscore Boundary prediction: 0.1046 - Absolute Seg Boundary Fscore Boundary prediction: 0.0 - Spike Seg Type Fscore Increase in boundary prediction: 0.1046 - Spike Seg Boundary Fscore Increase in boundary prediction: 0.0 - Absolute Seg Type Fscore Increase in boundary prediction: 0.1046 - Absolute Seg Boundary Fscore Increase in boundary prediction: 0.0 - Spike Seg Type Fscore Feature loss: 0.1769 - Spike Seg Boundary Fscore Feature loss: 0.3069 - Absolute Seg Type Fscore Feature loss: 0.1876 - Absolute Seg Boundary Fscore Feature loss: 0.4637 - Spike Seg Type Fscore Increase in feature loss: 0.1734 - Spike Seg Boundary Fscore Increase in feature loss: 0.2862 - Absolute Seg Type Fscore Increase in feature loss: 0.2036 - Absolute Seg Boundary Fscore Increase in feature loss: 0.4010 - Spike Seg Type Fscore Feature entropy: 0.2182 - Spike Seg Boundary Fscore Feature entropy: 0.3556 - Absolute Seg Type Fscore Feature entropy: 0.1876 - Absolute Seg Boundary Fscore Feature entropy: 0.4637 - Spike Seg Type Fscore Increase in feature entropy: 0.2182 - Spike Seg Boundary Fscore Increase in feature entropy: 0.3556 - Absolute Seg Type Fscore Increase in feature entropy: 0.2053 - Absolute Seg Boundary Fscore Increase in feature entropy: 0.4262 - Spike Seg Type Fscore Loss deviation: 0.1549 - Spike Seg Boundary Fscore Loss deviation: 0.2226 - Absolute Seg Type Fscore Loss deviation: 0.1997 - Absolute Seg Boundary Fscore Loss deviation: 0.4264 - Spike Seg Type Fscore Increase in loss deviation: 0.2074 - Spike Seg Boundary Fscore Increase in loss deviation: 0.3024 - Absolute Seg Type Fscore Increase in loss deviation: 0.1749 - Absolute Seg Boundary Fscore Increase in loss deviation: 0.3652 - Spike Seg Type Fscore Boundary feature prediction: 0.2089 - Spike Seg Boundary Fscore Boundary feature prediction: 0.3110 - Absolute Seg Type Fscore Boundary feature prediction: 0.2044 - Absolute Seg Boundary Fscore Boundary feature prediction: 0.3455 - Spike Seg Type Fscore Increase in boundary feature prediction: 0.1950 - Spike Seg Boundary Fscore Increase in boundary feature prediction: 0.2901 - Absolute Seg Type Fscore Increase in boundary feature prediction: 0.2060 - Absolute Seg Boundary Fscore Increase in boundary feature prediction: 0.4438 - Spike Seg Type Fscore Majority vote cutoff: 0.1738 - Spike Seg Type Fscore Majority vote spike: 0.1588 - Absolute Seg Type Fscore Majority vote cutoff: 0.1793 - Absolute Seg Type Fscore Majority vote spike: 0.1046 - Spike Seg Boundary Fscore Majority vote cutoff: 0.3186 - Spike Seg Boundary Fscore Majority vote spike: 0.2530 - Absolute Seg Boundary Fscore Majority vote cutoff: 0.3075 - Absolute Seg Boundary Fscore Majority vote spike: 0.0 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 0.001 - train_batch_size: 32 - eval_batch_size: 32 - seed: 42 - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments - lr_scheduler_type: linear - lr_scheduler_warmup_steps: 10 - training_steps: 100 ### Training results | Training Loss | Epoch | Step | Validation Loss | Model Preparation Time | Perplexity | Bpc | Spike Seg Type Fscore Entropy | Spike Seg Boundary Fscore Entropy | Absolute Seg Type Fscore Entropy | Absolute Seg Boundary Fscore Entropy | Spike Seg Type Fscore Increase in entropy | Spike Seg Boundary Fscore Increase in entropy | Absolute Seg Type Fscore Increase in entropy | Absolute Seg Boundary Fscore Increase in entropy | Spike Seg Type Fscore Loss | Spike Seg Boundary Fscore Loss | Absolute Seg Type Fscore Loss | Absolute Seg Boundary Fscore Loss | Spike Seg Type Fscore Increase in loss | Spike Seg Boundary Fscore Increase in loss | Absolute Seg Type Fscore Increase in loss | Absolute Seg Boundary Fscore Increase in loss | Spike Seg Type Fscore Rank | Spike Seg Boundary Fscore Rank | Absolute Seg Type Fscore Rank | Absolute Seg Boundary Fscore Rank | Spike Seg Type Fscore Increase in rank | Spike Seg Boundary Fscore Increase in rank | Absolute Seg Type Fscore Increase in rank | Absolute Seg Boundary Fscore Increase in rank | Spike Seg Type Fscore Boundary prediction | Spike Seg Boundary Fscore Boundary prediction | Absolute Seg Type Fscore Boundary prediction | Absolute Seg Boundary Fscore Boundary prediction | Spike Seg Type Fscore Increase in boundary prediction | Spike Seg Boundary Fscore Increase in boundary prediction | Absolute Seg Type Fscore Increase in boundary prediction | Absolute Seg Boundary Fscore Increase in boundary prediction | Spike Seg Type Fscore Feature loss | Spike Seg Boundary Fscore Feature loss | Absolute Seg Type Fscore Feature loss | Absolute Seg Boundary Fscore Feature loss | Spike Seg Type Fscore Increase in feature loss | Spike Seg Boundary Fscore Increase in feature loss | Absolute Seg Type Fscore Increase in feature loss | Absolute Seg Boundary Fscore Increase in feature loss | Spike Seg Type Fscore Feature entropy | Spike Seg Boundary Fscore Feature entropy | Absolute Seg Type Fscore Feature entropy | Absolute Seg Boundary Fscore Feature entropy | Spike Seg Type Fscore Increase in feature entropy | Spike Seg Boundary Fscore Increase in feature entropy | Absolute Seg Type Fscore Increase in feature entropy | Absolute Seg Boundary Fscore Increase in feature entropy | Spike Seg Type Fscore Loss deviation | Spike Seg Boundary Fscore Loss deviation | Absolute Seg Type Fscore Loss deviation | Absolute Seg Boundary Fscore Loss deviation | Spike Seg Type Fscore Increase in loss deviation | Spike Seg Boundary Fscore Increase in loss deviation | Absolute Seg Type Fscore Increase in loss deviation | Absolute Seg Boundary Fscore Increase in loss deviation | Spike Seg Type Fscore Boundary feature prediction | Spike Seg Boundary Fscore Boundary feature prediction | Absolute Seg Type Fscore Boundary feature prediction | Absolute Seg Boundary Fscore Boundary feature prediction | Spike Seg Type Fscore Increase in boundary feature prediction | Spike Seg Boundary Fscore Increase in boundary feature prediction | Absolute Seg Type Fscore Increase in boundary feature prediction | Absolute Seg Boundary Fscore Increase in boundary feature prediction | Spike Seg Type Fscore Majority vote cutoff | Spike Seg Type Fscore Majority vote spike | Absolute Seg Type Fscore Majority vote cutoff | Absolute Seg Type Fscore Majority vote spike | Spike Seg Boundary Fscore Majority vote cutoff | Spike Seg Boundary Fscore Majority vote spike | Absolute Seg Boundary Fscore Majority vote cutoff | Absolute Seg Boundary Fscore Majority vote spike | |:-------------:|:------:|:----:|:---------------:|:----------------------:|:----------:|:------:|:-----------------------------:|:---------------------------------:|:--------------------------------:|:------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:------------------------------------------------:|:--------------------------:|:------------------------------:|:-----------------------------:|:---------------------------------:|:--------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------:|:------------------------------:|:-----------------------------:|:---------------------------------:|:--------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:------------------------------------------------:|:-----------------------------------------------------:|:---------------------------------------------------------:|:--------------------------------------------------------:|:------------------------------------------------------------:|:----------------------------------:|:--------------------------------------:|:-------------------------------------:|:-----------------------------------------:|:----------------------------------------------:|:--------------------------------------------------:|:-------------------------------------------------:|:-----------------------------------------------------:|:-------------------------------------:|:-----------------------------------------:|:----------------------------------------:|:--------------------------------------------:|:-------------------------------------------------:|:-----------------------------------------------------:|:----------------------------------------------------:|:--------------------------------------------------------:|:------------------------------------:|:----------------------------------------:|:---------------------------------------:|:-------------------------------------------:|:------------------------------------------------:|:----------------------------------------------------:|:---------------------------------------------------:|:-------------------------------------------------------:|:-------------------------------------------------:|:-----------------------------------------------------:|:----------------------------------------------------:|:--------------------------------------------------------:|:-------------------------------------------------------------:|:-----------------------------------------------------------------:|:----------------------------------------------------------------:|:--------------------------------------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:----------------------------------------------:|:---------------------------------------------:|:-------------------------------------------------:|:------------------------------------------------:| | 0.0087 | 1.1111 | 50 | 0.0075 | 0.0047 | 1.0075 | 0.0108 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1127 | 0.2672 | 0.1283 | 0.4786 | 0.1357 | 0.3345 | 0.1048 | 0.4574 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1926 | 0.3064 | 0.1876 | 0.4637 | 0.1769 | 0.3069 | 0.1876 | 0.4637 | 0.1926 | 0.3064 | 0.1876 | 0.4637 | 0.1769 | 0.3069 | 0.1876 | 0.4637 | 0.1549 | 0.2226 | 0.1997 | 0.4264 | 0.2074 | 0.3024 | 0.1749 | 0.3652 | 0.2089 | 0.3110 | 0.2044 | 0.3455 | 0.1950 | 0.2901 | 0.2060 | 0.4438 | 0.1756 | 0.1735 | 0.1728 | 0.1046 | 0.2901 | 0.3231 | 0.3439 | 0.0 | | 0.0061 | 2.2222 | 100 | 0.0053 | 0.0047 | 1.0053 | 0.0077 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1127 | 0.2672 | 0.1283 | 0.4786 | 0.1357 | 0.3345 | 0.1048 | 0.4574 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1046 | 0.0 | 0.1769 | 0.3069 | 0.1876 | 0.4637 | 0.1734 | 0.2862 | 0.2036 | 0.4010 | 0.2182 | 0.3556 | 0.1876 | 0.4637 | 0.2182 | 0.3556 | 0.2053 | 0.4262 | 0.1549 | 0.2226 | 0.1997 | 0.4264 | 0.2074 | 0.3024 | 0.1749 | 0.3652 | 0.2089 | 0.3110 | 0.2044 | 0.3455 | 0.1950 | 0.2901 | 0.2060 | 0.4438 | 0.1738 | 0.1588 | 0.1793 | 0.1046 | 0.3186 | 0.2530 | 0.3075 | 0.0 | ### Framework versions - Transformers 4.48.1 - Pytorch 2.5.1 - Datasets 2.18.0 - Tokenizers 0.21.0