Bielik-11B-v2.6-Instruct-bnb-4bit

This repo contains Bitsandbytes format model files for SpeakLeash's Bielik-11B-v2.6-Instruct.

DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!

Model description:

Responsible for model quantization

  • Remigiusz KinasSpeakLeash - team leadership, conceptualizing, calibration data preparation, process creation and quantized model delivery.

Contact Us

If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.

Downloads last month
103
Safetensors
Model size
5.89B params
Tensor type
F32
F16
U8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for speakleash/Bielik-11B-v2.6-Instruct-bnb-4bit

Quantized
(7)
this model