Update README.md
Browse files
README.md
CHANGED
|
@@ -8,8 +8,21 @@ model-index:
|
|
| 8 |
results: []
|
| 9 |
---
|
| 10 |
|
| 11 |
-
|
| 12 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
|
| 14 |
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|
| 15 |
<details><summary>See axolotl config</summary>
|
|
|
|
| 8 |
results: []
|
| 9 |
---
|
| 10 |
|
| 11 |
+
Trying out some LISA training.
|
| 12 |
+
A few too many numbers changed to be quite directly comparable, but here's the nous-eval comparisons with the CosmoAlpacaLight using LORA:
|
| 13 |
+
|
| 14 |
+
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|
| 15 |
+
|-----------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|
| 16 |
+
|[CosmoAlpacaLisa-1b](https://huggingface.co/Lambent/CosmoAlpacaLisa-1b)| 23.89| 51.93| 39.93| 28.68| 36.11|
|
| 17 |
+
|
| 18 |
+
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|
| 19 |
+
|-------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|
| 20 |
+
|[CosmoAlpacaLight-1b](https://huggingface.co/Lambent/CosmoAlpacaLight-1b)| 24.28| 51.31| 40.33| 29.47| 36.35|
|
| 21 |
+
|
| 22 |
+
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|
| 23 |
+
|---------------------------------------------------------|------:|------:|---------:|-------:|------:|
|
| 24 |
+
|[cosmo-1b](https://huggingface.co/HuggingFaceTB/cosmo-1b)| 22.97| 52.01| 38.02| 28.73| 35.43|
|
| 25 |
+
|
| 26 |
|
| 27 |
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|
| 28 |
<details><summary>See axolotl config</summary>
|