readme: ---
  license: mit
  tags:
  - text-classification
  - PyTorch
  - Transformers
  ---
  
  
  # fakeBert
  
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on a [news dataset](https://www.kaggle.com/datasets/clmentbisaillon/fake-and-real-news-dataset) from Kaggle.
  
  ## Model description
  
  Fine-tuning Bert for text classification.
  
  ## Training and evaluation data
  
  Training & Validation: [Fake and real news dataset](https://www.kaggle.com/datasets/clmentbisaillon/fake-and-real-news-dataset)
  Testing: [Fake News Detection Challenge KDD 2020](https://www.kaggle.com/competitions/fakenewskdd2020/overview)
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 1e-5
  - train_batch_size: 16
  - eval_batch_size: 16
  - optimizer: AdamW
  