Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
TheBloke
/
dolphin-2.6-mixtral-8x7b-GPTQ
like
6
Text Generation
Transformers
Safetensors
7 datasets
English
mixtral
conversational
text-generation-inference
4-bit precision
gptq
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
Sort: Recently created
KeyError: 'model.layers.0.block_sparse_moe.experts.0.w1.g_idx' when running with tensor parallelism on vllm
1
#1 opened over 1 year ago by
KronusCon
