StableLM-2-Zephyr-1.6B-GGUF

Original Model

stabilityai/stablelm-2-zephyr-1_6b

Run with Gaianet

Prompt template:

prompt template: llama-2-chat

Context size:

chat_ctx_size: 4096

Run with GaiaNet:

Downloads last month
26
GGUF
Model size
1.64B params
Architecture
stablelm
Hardware compatibility
Log In to view the estimation

5-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for gaianet/stablelm-2-zephyr-1.6b-GGUF

Quantized
(14)
this model

Datasets used to train gaianet/stablelm-2-zephyr-1.6b-GGUF