Menlo/Jan-nano-gguf

Jan Nano

Authors: Alan Dao, Bach Vu Dinh, Thinh

Overview

Jan Nano is a fine-tuned language model built on top of the Qwen3 architecture. Developed as part of the Jan ecosystem, it balances compact size and extended context length, making it ideal for efficient, high-quality text generation in local or embedded environments.

Features

• Tool Use: Excellent function calling and tool integration
• Research: Enhanced research and information processing capabilities
• Small Model: VRAM efficient for local deployment

Use it with Jan (UI)

1. Install Jan using Quickstart

Original weight: https://huggingface.co/Menlo/Jan-nano

Recommended Sampling Parameters

• Temperature: 0.7
• Top-p: 0.8
• Top-k: 20
• Min-p: 0

Documentation

Setup, Usage & FAQ