exllamav2 quantizations of sophosympatheia's StrawberryLemonade-L3-70B-v1.0
2.25bpw h6 (20.686 GiB)
4.25bpw h6 (26.623 GiB)
6.00bpw h6 (Now uploading) (50.568 GiB)
8.00bpw h8 (Now uploading) (66.711 GiB)
measurement.json
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support