bmm is currently not implemented for torch.sparse.* modules. If you can store it in a list, you can simply do torch.mm(mat1_i, mat2). If your matricies are extremely sparse, this should be pretty good 
Also, torch.smm(mat1_i, mat2) is also implemented, for sparse * dense -> sparse operations.