readme: ---
  tags:
  - generated_from_keras_callback
  model-index:
  - name: botModel77k
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information Keras had access to. You should
  probably proofread and complete it, then remove this comment. -->
  
  # botModel77k
  
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
  It achieves the following results on the evaluation set:
  - Train Loss: 2.3771
  - Train Accuracy: 0.0094
  - Train Perplexity: 30333.5410
  - Validation Loss: 2.0934
  - Validation Accuracy: 0.0014
  - Validation Perplexity: 26480.1133
  - Epoch: 6
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - optimizer: {'name': 'AdamW', 'weight_decay': 0.004, 'clipnorm': None, 'global_clipnorm': None, 'clipvalue': None, 'use_ema': False, 'ema_momentum': 0.99, 'ema_overwrite_frequency': None, 'jit_compile': True, 'is_legacy_optimizer': False, 'learning_rate': 0.0002996201, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False}
  - training_precision: float32
  
  ### Training results
  
  | Train Loss | Train Accuracy | Train Perplexity | Validation Loss | Validation Accuracy | Validation Perplexity | Epoch |
  |:----------:|:--------------:|:----------------:|:---------------:|:-------------------:|:---------------------:|:-----:|
  | 2.5103     | 0.0102         | 58124.6016       | 2.4480          | 0.0133              | 3368.8555             | 0     |
  | 2.6982     | 0.0257         | 7501.5615        | 2.6316          | 0.0096              | 2922.6921             | 1     |
  | 2.8415     | 0.0394         | 10605.6260       | 2.5974          | 0.0379              | 7290.8931             | 2     |
  | 2.8297     | 0.0346         | 12593.2070       | 2.5745          | 0.0143              | 12899.2344            | 3     |
  | 2.6907     | 0.0419         | 12714.2070       | 2.2249          | 0.0047              | 8324.0859             | 4     |
  | 2.3970     | 0.0117         | 24682.5586       | 2.2268          | 0.0013              | 35696.6914            | 5     |
  | 2.3771     | 0.0094         | 30333.5410       | 2.0934          | 0.0014              | 26480.1133            | 6     |
  
  
  ### Framework versions
  
  - Transformers 4.26.0
  - TensorFlow 2.11.0
  - Datasets 2.9.0
  - Tokenizers 0.13.2
  