Solved by mMagmer in post #2 
              
              
                Suppose we have two sequential layers. 
Then grad_output is the gradient of the second layer output with respect to the input of itself (first layer output). 
in your case , you calling backward on a scaler (a tensor of one item) , and buy default grad is set to 1 for scaler output.