This is a quantized version of the Stable LM 2 Zephyr 1.6B model, see the model card for a model description and license.
This quantized version has been generated from the
model.safetensors weights file
using the Candle tensor-tools application:
tensor-tools quantize --quantization q4_1 --out-file stablelm-2-zephyr-1_6b-Q4_1.gguf model.safetensors
- Downloads last month
- 6
Hardware compatibility
Log In
to view the estimation
4-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for vincevas/coze-stablelm-2-1_6b
Base model
stabilityai/stablelm-2-zephyr-1_6b