Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
此模型為 taide/Llama-3.1-TAIDE-LX-8B-Chat 的 exllamav2 格式的量化版本。模型的規格詳情請參考原始模型頁面。
可使用 tabbyAPI 載入此模型,並以 AnythingLLM 作為互動界面。
- Downloads last month
- 0
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for koungho/Llama-3.1-TAIDE-LX-8B-Chat-EXL2-4.5bpw
Base model
taide/Llama-3.1-TAIDE-LX-8B-Chat