I just found that the weight has been updated, but the loss did not change. That’s why I thought the weight has not been updated. This goes to another problem, I will figure out which part of my network is wrong. Thank u very much!