AI, Developer, Application, Model, Intel.
Using OpenVINO™: Weight Compression Using NNCF: To reduce the memory footprint and improve the inference performance of the Language Model, weight compression is applied using the Neural Network Compression Framework (NNCF). This method is highly effective for large memory-bound models like LLMs.