Quantization, Llm, Large Language Models, Langchain, Text Generation.
big difference between storing int as binary and float as such. Let’s try converting 20.23 to binary: Converting float to binary As one can see, the floating part (mantissa) is calculated as the combination of 1/2^n, and cannot be calculated very precisely, even with 10 bits dedicated to the