SmolLM3-3B-GGUF / README.md
apepkuss79's picture
Update README.md
ab63ce9 verified
metadata
base_model: HuggingFaceTB/SmolLM3-3B
license: apache-2.0
library_name: transformers
model_creator: HuggingFaceTB
model_name: SmolLM3-3B
quantized_by: Second State Inc.
language:
  - en
  - fr
  - es
  - it
  - pt
  - zh
  - ar
  - ru

SmolLM3-3B-GGUF

Original Model

HuggingFaceTB/SmolLM3-3B

Run with Gaianet

Prompt template:

prompt template: smol3-no-think

Context size:

chat_ctx_size: 128000

Run with GaiaNet:

Quantized with llama.cpp b5889