Nanonets-OCR-s-GGUF / README.md
benhaotang's picture
update lmstudio instructions
ed7c009 verified
|
raw
history blame
566 Bytes
metadata
license: apache-2.0
language:
  - en
base_model: nanonets/Nanonets-OCR-s
pipeline_tag: image-text-to-text
tags:
  - OCR

Quatized nanonets/Nanonets-OCR-s with llama.cpp commit fb85a288

Multiple ways to use:

  • run with llama.cpp: ./llama-server -m "Nanonets-OCR-s-Q4_K_M.gguf" --mmproj "mmproj-Nanonets-OCR-s.gguf"
  • use with lmstudio: just pull from benhaotang/Nanonets-OCR-s-GGUF (Warning: change chat template to chatml in model settings)
  • use with ollama: ollama run benhaotang/Nanonets-OCR-s