Ollama
#6
by
dangrsosig
- opened
None of the ggufs works in ollama. You can pull them but trying to run them results in this error message:
Error: 500 Internal Server Error: unable to load model
Ollama likely needs modifications; it may be using an outdated version of llama.cpp. Replace it with the latest version and recompile.