Thanks! I already looked at this page. It’s actually still unclear to me what the purpose is for sharded_ddp, given it seems to be related to deepspeed. Could you explain a bit more on the usage of sharded_ddp? Thanks!