Artificial Intelligence, Machine Learning, Parallel Computing, Diffusion Models, Content Generation.
checkpoint Colossal-AI uses activation checkpointing to compress memory usage during the training of large machine learning models. Instead of storing the entire model, activations of intermediate layers are stored. Colossal-AI’s automatic search function for activation checkpointing finds the most