first, very thanks for reply. I have question, when i always zero some weights , whether the backward() actually will calculate all the gradient of weight？I hope backward() does not calculate zeroed weight