Latxa 7b Instruct GGUF

Provided files

Name Quant method Bits Size Max RAM required Use case
latxa-7b-v1-instruct-q8_0.gguf 8 bits 7 GB 8,2 GB Fits in a RTX 3060 12Gb
Downloads last month
9
GGUF
Model size
6.74B params
Architecture
llama
Hardware compatibility
Log In to view the estimation
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for oldbridge/latxa-7b-instruct-q8

Base model

HiTZ/latxa-7b-v1
Quantized
(1)
this model