What is the _K on the new files ?

#14

by Fabienne - opened Aug 18

Aug 18

•

what is it ?
_K
_K_S...

Aug 18

Mixed precision quantization. The original pr has some good explanations https://github.com/ggerganov/llama.cpp/pull/1684

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment