No. My case is one-machine-multiple-gpu. On this occasion, is if accelerator.is_main_process: necessary or should I just delete it? (Sry, I’m not so familiar with the mechanism of accelerate package.)