Joseph717171
/

DeepHermes-3-Llama-3.1-8B-Preview-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

GGUF

conversational

Model card Files Files and versions

xet

Community

DeepHermes-3-Llama-3.1-8B-Preview-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF / README.md

Joseph717171

Update README.md

ed4a495 verified 2 months ago

preview code

raw

history blame contribute delete

261 Bytes

Custom GGUF quants of NousResearch/DeepHermes-3-Llama-3-8B-Preview, where the Output Tensors are kept at F32 or quantized to Q8_0, while the Embeddings are kept at F32. Enjoy! 🧠🔥🚀