benhaotang
/

Nanonets-OCR-s-GGUF

Image-Text-to-Text

Model card Files Files and versions

benhaotang commited on Jun 14

Commit

ed7c009

·

verified ·

1 Parent(s): d61ec7f

update lmstudio instructions

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -13,5 +13,5 @@ Quatized [nanonets/Nanonets-OCR-s](https://huggingface.co/nanonets/Nanonets-OCR-
 Multiple ways to use:
 - run with llama.cpp: `./llama-server -m "Nanonets-OCR-s-Q4_K_M.gguf" --mmproj "mmproj-Nanonets-OCR-s.gguf"`
-- ~~use with lmstudio: just pull from `benhaotang/Nanonets-OCR-s-GGUF`~~ (Warning: lmstudio seems to apply an incorrect chat template, still looking into it)
 - use with ollama: `ollama run benhaotang/Nanonets-OCR-s`

 Multiple ways to use:
 - run with llama.cpp: `./llama-server -m "Nanonets-OCR-s-Q4_K_M.gguf" --mmproj "mmproj-Nanonets-OCR-s.gguf"`
+- use with lmstudio: just pull from `benhaotang/Nanonets-OCR-s-GGUF` **(Warning: change chat template to chatml in model settings)**
 - use with ollama: `ollama run benhaotang/Nanonets-OCR-s`