Llm, Model Quantization, Deep Learning, Machine Learning, Large Language Models.
Gradients: Compared to the above, gradients are slightly less common because they are mainly used for training. When training deep learning models, gradients are usually floating-point numbers. They mainly serve to reduce communication overhead in distributed computing and can also reduce the cost