My GGUF-IQ-Imatrix quants for the experimental model saishf/Neural-SOVLish-Devil-8B-L3.
The usual Llama-3 presets. Author feedback is apreciated for this experimental model.

image/png

Downloads last month
35
GGUF
Model size
8.03B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support