radi-cho's picture
Update README.md
a63ced1 verified
metadata
license: llama3
Wiki C4
W4G64 6.78 10.61
W3G64 7.75 12.28

Revisions available in this repository:

  • main (W4G64, scales learned);
  • nfl_w3g64 (W3G64, scales learned);
  • nf_w4g64 (W4G64, scales not learned);
  • nf_w3g64 (W3G64, scales not learned);

Evaluations are provided for models with learned scales.
Check the base Meta-Llama-3-8B-FLUTE for lm-eval-harness benchmarks.