Hi,
I’m trying to calculate a gradient w.r.t a sparse matrix. It seems like pytorch’s autograd doesn’t support getting the gradient for sparse matrix so I want to calculate it manually if it’s possible.
the forward function is softmax(A*AXW). A is a sparse matrix and I want to calculate the gradient w.r.t A
thanks!