Dolphin-2.6-mistral-7b-GGUF

Model Description

  • Model was created by cognitivecomputations
  • This model is based on Mistral-7b
  • The base model has 16k context
  • This model is uncensored, hence users are responsible for the contentthey create using this model
Downloads last month
40
GGUF
Model size
7.24B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for QuantFactory/dolphin-2.6-mistral-7b-GGUF

Quantized
(10)
this model