File size: 539 Bytes
5576073
 
 
 
5673c66
 
 
a26a399
 
 
 
 
 
 
 
 
a63ced1
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
---
license: llama3
---

|             | Wiki | C4    |
| ----------- | ---- | ----- |
| W4G64       | 6.78 | 10.61 |
| W3G64       | 7.75 | 12.28 |


Revisions available in this repository:
- `main` (W4G64, scales learned);
- `nfl_w3g64` (W3G64, scales learned);
- `nf_w4g64` (W4G64, scales not learned);
- `nf_w3g64` (W3G64, scales not learned);

Evaluations are provided for models with learned scales.<br>
Check the base [`Meta-Llama-3-8B-FLUTE`](https://huggingface.co/radi-cho/Meta-Llama-3-8B-FLUTE) for `lm-eval-harness` benchmarks.