---
license: apache-2.0
language:
  - en
base_model: nanonets/Nanonets-OCR-s
pipeline_tag: image-text-to-text
tags:
  - OCR
---

Quatized [nanonets/Nanonets-OCR-s](https://huggingface.co/nanonets/Nanonets-OCR-s) with llama.cpp commit fb85a288

Multiple ways to use:

- run with llama.cpp: `./llama-server -m "Nanonets-OCR-s-Q4_K_M.gguf" --mmproj "mmproj-Nanonets-OCR-s.gguf"`
- use with lmstudio: just pull from `benhaotang/Nanonets-OCR-s-GGUF` **(Warning: change chat template to chatml in model settings)**
- use with ollama: `ollama run benhaotang/Nanonets-OCR-s`