Update README.md
Browse files
README.md
CHANGED
|
@@ -31,7 +31,7 @@ Other version: lower the expert to 2:
|
|
| 31 |
# You may want see this: https://huggingface.co/Alsebay/My_LLMs_Leaderboard
|
| 32 |
# It's ridiculous that I can run this original version in 4bit, but can't run in GGUF version. Maybe my GPU can't handle it?
|
| 33 |
|
| 34 |
-
Have try from Q2 to fp16, no hope. 😥 Seem that there is a bug in model pointer.
|
| 35 |
|
| 36 |
Link here: https://huggingface.co/Alsebay/HyouKan-GGUF
|
| 37 |
|
|
|
|
| 31 |
# You may want see this: https://huggingface.co/Alsebay/My_LLMs_Leaderboard
|
| 32 |
# It's ridiculous that I can run this original version in 4bit, but can't run in GGUF version. Maybe my GPU can't handle it?
|
| 33 |
|
| 34 |
+
Have try from Q2 to fp16, no hope. 😥 Seem that there is a bug in model pointer. maybe cause by Sao10K/Frostwind-v2.1-m7 because it a experimental model.
|
| 35 |
|
| 36 |
Link here: https://huggingface.co/Alsebay/HyouKan-GGUF
|
| 37 |
|