Llm, Knowledge Distillation, Quantization, Online Advertising, AI.
Compression [Dettmers et al.] — Model compression utilizes a collection of techniques, including pruning and quantization, to reduce model size and complexity. Pruning typically involves removing encoder/decoder layers or blocks and decreasing the number of hidden units per layer, thus lowering the