GPTQ 4-bit no actor version for compatibility that works in textgen-webui
Generated by using scripts from https://gitee.com/yhyu13/llama_-tools
Original delta weight : https://huggingface.co/OptimalScale/robin-13b-v2-delta
Merged weight : https://huggingface.co/TheBloke/robin-13B-v2-fp16
- Downloads last month
- 9
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support