Artificial Intelligence, Machine Learning, Llm, Fine Tuning, Mlops.
include: Sparse Models Prunes redundant connections in dense transformer models. Reduces compute for faster fine-tuning and inference. Mixture of Experts Partitions model into sparsely activated expert subnets specialized on subsets of data. Improves scaling. Adapter Layers Small contextual