|
|
--- |
|
|
license: llama3 |
|
|
--- |
|
|
|
|
|
| | Wiki | C4 | |
|
|
| ----------- | ---- | ----- | |
|
|
| W4G64 | 6.78 | 10.61 | |
|
|
| W3G64 | 7.75 | 12.28 | |
|
|
|
|
|
|
|
|
Revisions available in this repository: |
|
|
- `main` (W4G64, scales learned); |
|
|
- `nfl_w3g64` (W3G64, scales learned); |
|
|
- `nf_w4g64` (W4G64, scales not learned); |
|
|
- `nf_w3g64` (W3G64, scales not learned); |
|
|
|
|
|
Evaluations are provided for models with learned scales.<br> |
|
|
Check the base [`Meta-Llama-3-8B-FLUTE`](https://huggingface.co/radi-cho/Meta-Llama-3-8B-FLUTE) for `lm-eval-harness` benchmarks. |
