I think there are a few things here:

I believe the issue with the first thing is that internally when calling mm on Variables, it calls torch.addmm and we don’t have the proper function defined on Sparse Tensors. (We actually have this implemented, but I think its named incorrectly)
I’m less certain about nn.Parameter, I’ll have to let someone else answer that.

I will file an issue for #1.