Solved by albanD in post #2 
              
              
                Hi, 
Unfortunately, at the moment, very few of the backward formulas formulas support sparse gradients  
But you can call autograd.grad(out, inp, sparse_grad_out) to try and propagate sparse gradient in the backward pass. 
If you want to create them during the backward, I think a custom Function can…