readme: ---
  thumbnail: https://github.com/SauravMaheshkar/CommonLit-Readibility/blob/main/assets/CommonLit%20-%20Big%20Banner.png?raw=true
  tags:
  - kaggle
  license: cc0-1.0
  datasets:
  - Commonlit-Readibility
  ---
  ![](https://github.com/SauravMaheshkar/CommonLit-Readibility/blob/main/assets/CommonLit%20-%20Big%20Banner.png?raw=true)
  # FineTuning
  |       **Architecture**      |     **Weights**     | **Training Loss** | **Validation Loss** |
  |:-----------------------:|:---------------:|:----------------:|:----------------------:|
  |       roberta-base      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-roberta-base) |      **0.641**      |          **0.4728**         |
  |    bert-base-uncased    | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-bert-base-uncased) |      0.6781     |          0.4977         |
  |      albert-base      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-albert-base) |       0.7119      |          0.5155         |
  |       xlm-roberta-base       | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-xlm-roberta-base) |      0.7225      |          0.525          |
  |      bert-large-uncased      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-bert-large-uncased) |      0.7482      |         0.5161         |
  |       albert-large      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-albert-large) |      1.075      |          0.9921         |
  | roberta-large | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-roberta-large) |       2.749      |          1.075         |
  