Update README.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@ tags:
|
|
| 10 |
|
| 11 |
Envoid_Mixtral-Instruct-ITR-8x7B quantized with love.
|
| 12 |
|
| 13 |
-
Starting out with Q4_K_M,
|
| 14 |
|
| 15 |
First time doing quantizations so any feedback is greatly appreciated.
|
| 16 |
|
|
|
|
| 10 |
|
| 11 |
Envoid_Mixtral-Instruct-ITR-8x7B quantized with love.
|
| 12 |
|
| 13 |
+
Starting out with Q4_K_M, and iterating from there. Future plans for imatrix/IQ quants (pending compute power).
|
| 14 |
|
| 15 |
First time doing quantizations so any feedback is greatly appreciated.
|
| 16 |
|