File size: 355 Bytes
692b72e 32ef799 |
1 2 3 4 5 6 7 8 9 10 11 12 |
---
base_model: 01-ai/Yi-34B
datasets:
- ikawrakow/imatrix-from-wiki-train
---
# IQ3 quants of NousResearch/Nous-Hermes-2-Yi-34B
Created using llama.cpp 9e359a4f, with default settings of both convert.py and quantize using the imatrix provided by ikawrakow.
See https://github.com/ggerganov/llama.cpp/pull/5676 for information on the IQ3 quantization.
|