Fp8 / int4

#4
by Milor123 - opened

Guys could please convert each model with the respective Fp8 and int5 or gguf files, i cant found it in hugging face. Only 1 man try upload a fp8 of the full version but its is very big for me (12gb)

Thank u very much !

Sign up or log in to comment