Hugging Face's logo

benhaotang
/
Nanonets-OCR-s-GGUF

Image-Text-to-Text
GGUF
English
OCR
qwen2_5_vl
Model card Files
xet
Community
1
benhaotang commited on
Commit
d61ec7f
·
verified ·
1 Parent(s): 05fda1f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -10,6 +10,8 @@ tags:
10
 
11
  Quatized [nanonets/Nanonets-OCR-s](https://huggingface.co/nanonets/Nanonets-OCR-s) with llama.cpp commit fb85a288
12
 
13
- run with
14
 
15
- `./llama-server -m "Nanonets-OCR-s-Q4_K_M.gguf" --mmproj "mmproj-Nanonets-OCR-s.gguf"`
 
 
 
10
 
11
  Quatized [nanonets/Nanonets-OCR-s](https://huggingface.co/nanonets/Nanonets-OCR-s) with llama.cpp commit fb85a288
12
 
13
+ Multiple ways to use:
14
 
15
+ - run with llama.cpp: `./llama-server -m "Nanonets-OCR-s-Q4_K_M.gguf" --mmproj "mmproj-Nanonets-OCR-s.gguf"`
16
+ - ~~use with lmstudio: just pull from `benhaotang/Nanonets-OCR-s-GGUF`~~ (Warning: lmstudio seems to apply an incorrect chat template, still looking into it)
17
+ - use with ollama: `ollama run benhaotang/Nanonets-OCR-s`