@stevenwjy Hi, thank you so much for your kind reply. The code is from this repo 1. I am trying to extend it to multi-gpus version. I think my modification is incorrect, too (as @H-Huang). However, I don’t know what is the proper way.