@Hongkai_Zheng ,
Many thanks for your reply!



 Hongkai_Zheng:

This is only true when you do standard network training that updates model after one forward-backward pair


My question are:
what is standard network training? such as, will modified yolov3 be updated by DDP automatically? why couldn’t the modified network be updated automatically by DDP? how could the modified yolov3 be updated manually?
is there any official example code about how to update models automatically or manually?