vilsonrodrigues
/

Hermes-2-Pro-Mistral-7B-Pruned50

Text Generation

text-generation-inference

Model card Files Files and versions Community

A Mistral-7B pruned50

Please see my tutorial to execute this model:

https://vilsonrodrigues.medium.com/sparse-quantize-and-serving-llms-with-neuralmagic-autogptq-and-vllm-03961b72ec3a

Downloads last month: 7

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support