[Request #53] - Click the link for more context.
aifeifei798/llama3-8B-DarkIdol-1.2

Use with the latest version of KoboldCpp, or this more up-to-date fork if you have issues.

โ‡ฒ Click here to expand/hide information โ€“ General chart with relative quant performance.

Recommended read:

"Which GGUF is right for me? (Opinionated)" by Artefact2

Click the image to view full size. "Which GGUF is right for me? (Opinionated)" by Artefact2 - Firs Graph

image

Downloads last month
131
GGUF
Model size
8.03B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Collection including LWDCLS/llama3-8B-DarkIdol-1.2-GGUF-IQ-Imatrix-Request