Artificial Intelligence, Machine Learning, Parallel Computing, Diffusion Models, Content Generation.
Low-Cost Inference for the 175 Billion BLOOM Model As models become larger, memory consumption during inference becomes a key factor to consider. For example, the open source 175 billion parameters BLOOM model released by Hugging Face requires at least 87.5GB/43.8GB of memory per GPU when using