EXL3 quants of arcee-ai/Virtuoso-Small
| Bits per Weight | Model Size | Link |
|---|---|---|
| 2.0 bpw | 5.45 GB | oobabooga/Virtuoso-Small-exl3:2.0bpw |
| 2.25 bpw | 5.87 GB | oobabooga/Virtuoso-Small-exl3:2.25bpw |
| 2.5 bpw | 6.28 GB | oobabooga/Virtuoso-Small-exl3:2.5bpw |
| 3.0 bpw | 7.11 GB | oobabooga/Virtuoso-Small-exl3:3.0bpw |
| 3.5 bpw | 7.93 GB | oobabooga/Virtuoso-Small-exl3:3.5bpw |
| 4.0 bpw | 8.76 GB | oobabooga/Virtuoso-Small-exl3:4.0bpw |
| 5.0 bpw | 10.41 GB | oobabooga/Virtuoso-Small-exl3:5.0bpw |
| 6.0 bpw | 12.06 GB | oobabooga/Virtuoso-Small-exl3:6.0bpw |
| 8.0 bpw | 15.36 GB | oobabooga/Virtuoso-Small-exl3:8.0bpw |
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support