Jan-v1-4B-GGUF / README.md
jan-hq's picture
Update README.md
24fe2c8 verified
|
raw
history blame
3.02 kB
metadata
license: apache-2.0
language:
  - en
base_model:
  - Qwen/Qwen3-4B-Thinking-2507
pipeline_tag: text-generation

Jan-v1: Advanced Agentic Language Model

GitHub License Jan App

Overview

Introducing Jan-v1, the first release in the Jan Family – specifically designed for advanced agentic reasoning and complex problem-solving within the Jan App. Building on the innovative agentic capabilities of our earlier Lucy model, Jan-v1 represents a significant leap forward through strategic model scaling.

Jan-v1 leverages the newly released Qwen3-4B-thinking model to deliver significantly enhanced reasoning capabilities and effective tool utilizatio. This architectural evolution is designed to deliver superior performance on complex agentic tasks, setting a new benchmark for accessible, high-performance AI.

Performance

Question Answering (SimpleQA)

For question-answering, Jan-v1 shows a significant performance gain from model scaling, achieving 91.2% accuracy.

image/png

The 91.2% SimpleQA accuracy represents a significant milestone in factual question answering for models of this scale, demonstrating the effectiveness of our scaling and fine-tuning approach.

Chat Benchmarks

These benchmarks evaluate the model's conversational and instructional capabilities.

image/png

Quick Start

Integration with Jan App

Jan-v1 is optimized for direct integration with the Jan App. Simply select the model from the Jan App interface for immediate access to its full capabilities.

image/gif

Local Deployment

Using vLLM:

vllm serve Menlo/Jan-v1 \
    --host 0.0.0.0 \
    --port 1234 \
    --enable-auto-tool-choice \
    --tool-call-parser hermes

Using llama.cpp:

llama-server --model jan-v1.gguf \
    --host 0.0.0.0 \
    --port 1234

Recommended Parameters

temperature: 0.6
top_p: 0.95
top_k: 20
min_p: 0.0
max_tokens: 2048

🀝 Community & Support

πŸ“„ Citation

Updated Soon