Vector Embeddings, Quantization, Vector Quantization.
input vector is then scaled and shifted according to these calculated factors and rounded to the nearest integer, resulting in an 8-bit representation. Scalar quantization compresses the embeddings by reducing the bit precision from 32-bit to 8-bit. This reduction significantly decreases the memory