Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
phi0112358 's Collections
Llamafile-2-Go-Deutsch
Experts for GPU-Poors

Experts for GPU-Poors

updated Aug 25, 2024

GGUFs, conventional and k-quants – both without imatrix. This should be faster for CPU inference. Right now DeepSee MoEs (Mixture of Experts)

Upvote
-

  • phi0112358/DeepSeek-V2-Lite-Chat-Q4_0-GGUF

    Updated Aug 18, 2024 • 19

  • phi0112358/DeepSeek-V2-Lite-Chat-Q8_0-GGUF

    Updated Aug 18, 2024 • 4

  • phi0112358/DeepSeek-Coder-V2-Lite-Base-Q4_K_S-GGUF

    Updated Aug 11, 2024 • 18

  • phi0112358/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF

    Updated Aug 11, 2024 • 10

  • phi0112358/DeepSeek-Coder-V2-Lite-Instruct-Q8_0-GGUF

    Updated Aug 18, 2024 • 17
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs