Crashes on koboldcpp...
#7
by
StandoCat
- opened
I click load, the command prompt runs for a second and then koboldcpp instantly closes. this is the first time a models caused me this issue. I am using the text-only GGUF model.
PLEASE READ THE MODEL CARD FIRST!
Neither koboldcpp nor gguf are recommended.
GGUF (Text-Only, not recommended): There is a significant degradation, even with the F16.
GGUF for text-only should be working after PR #9194 was merged.
It seems that you, or koboldcpp, is still using an old version of llama.cpp backend.
JosephusCheung
changed discussion status to
closed