Sparse Tensors in PyTorch
What is the current state of sparse tensors in PyTorch?
Ilya_Kostrikov
right now, the description / summary of this PR that was merged 11 hours ago gives a good idea of the current state of things:
smth
But we’re not documenting them on purpose, because they might undergo some more changes in the future. The first step was to implement sprase updates for Embedding. Can I ask what’s your use case?
apaszke
I need just basic sparse matrix multiplication in order to implement a Graph ConvNet model. For example: and The Laplacian matrix is extremely sparse is this case.
Ilya_Kostrikov
apaszke
I need sparse x dense -> dense. So I can use PyTorch in this case. Thanks a lot!
Ilya_Kostrikov
apaszke
But it’s not in autograd yet? Is there a fast way to add it?
Ilya_Kostrikov
a fast and local way is for you to write an autograd function for yourself.
smth
That’s my question too (now on 21st Sept).  Can anyone comment on the current state of sparse tensors in PyTorch? Thank you
hconroy
I would like to update variable with sparse gradients. and it’s normal.  I know that wasn’t support by tensorflow. so how about pytorch/. Thank you!
11131
What is the status of Sparse Support in PyTorch? I’d like to contribute to the module. What are the current design strategies in place? There seems to be no detail or comprehensive discussion on this aspect.
pradeepgopalakrishna
rajeshpiryani