IQ4_NL

#2
by SlavaTar - opened

Can you please add IQ4_NL, on a smartphone this version shows better performance and speed.

Unfortunately no, because llama.cpp can't generate that quant for this model if I remember correctly.

Thank you, it's a pity.

SlavaTar changed discussion status to closed

Sign up or log in to comment