Artificial Intelligence, Machine Learning, Parallel Computing, Diffusion Models, Content Generation.
obtain a meta model that takes up almost no memory, and then passes the model parameters between processes via gloo backend. This results in peak CPU memory usage reaching a theoretically optimal level without loading model parameters in segments, improving memory usage efficiency under