Ctranslate2 8-bit quantization of EXAONE-3.5-7.8B-Instruct.

However, this would not have been possible without the model first being converted to Llama format from here

Downloads last month
9
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for ctranslate2-4you/EXAONE-3.5-7.8B-Instruct-ct2-int8

Quantized
(18)
this model

Collection including ctranslate2-4you/EXAONE-3.5-7.8B-Instruct-ct2-int8