Hugging Face's logo

ReadyArt
/
Delta-Vector_Shimamura-70B-EXL2

EXL2
Model card Files
xet
Community

Shimamura-70B-EXL2

Released by Delta-Vector

Quant(s) by FrenzyBiscuit

4.0 BPW H6 - Fits in 48GB VRAM with 32k FP16 context

5.25 BPW H6 - Fits in 72GB VRAM with 64k FP16 context

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ReadyArt/Delta-Vector_Shimamura-70B-EXL2

Base model

zerofata/L3.3-GeneticLemonade-Unleashed-70B
Finetuned
zerofata/L3.3-GeneticLemonade-Unleashed-v3-70B
Finetuned
Delta-Vector/Shimamura-70B
Quantized
(3)
this model

Collection including ReadyArt/Delta-Vector_Shimamura-70B-EXL2