---
license: llama3
---

|             | Wiki | C4    |
| ----------- | ---- | ----- |
| W4G64       | 6.78 | 10.61 |
| W3G64       | 7.75 | 12.28 |


Revisions available in this repository:
- `main` (W4G64, scales learned);
- `nfl_w3g64` (W3G64, scales learned);
- `nf_w4g64` (W4G64, scales not learned);
- `nf_w3g64` (W3G64, scales not learned);

Evaluations are provided for models with learned scales.<br>
Check the base [`Meta-Llama-3-8B-FLUTE`](https://huggingface.co/radi-cho/Meta-Llama-3-8B-FLUTE) for `lm-eval-harness` benchmarks.