README.md

metadata

license: apache-2.0
language:
  - en
base_model: nanonets/Nanonets-OCR-s
pipeline_tag: image-text-to-text
tags:
  - OCR

Quatized nanonets/Nanonets-OCR-s with llama.cpp commit fb85a288

Multiple ways to use:

• run with llama.cpp: ./llama-server -m "Nanonets-OCR-s-Q4_K_M.gguf" --mmproj "mmproj-Nanonets-OCR-s.gguf"
• use with lmstudio: just pull from benhaotang/Nanonets-OCR-s-GGUF (Warning: lmstudio seems to apply an incorrect chat template, still looking into it)
• use with ollama: ollama run benhaotang/Nanonets-OCR-s