mdw:

if self.sparse_weights is None:
self.sparse_weights = sparse_weights


Hi!
Thank you for your post. I am experiencing exactly same problem in multiplying sparse tensor in autograd function.
I tried to implement this hack. It works but I found that it is actually slower than just using a dense tensor?
Could you please give me some hints about how did you have everything worked in the end?
Thank you very much for your reading