GGUF Imatrix Quants of https://huggingface.co/Vdr1/L3-8B-Sunfall-Stheno-v3.2

EXPERIMENTAL! Read information in the original model repo for recommended settings to get the best results.

Downloads last month
24
GGUF
Model size
8.03B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support