Thank you for reply!
In my case, one is a Batch (input) and one is a single matrix (weight of network). In order to use torch.bmm, i need to modify network weight. However, I found that torch.matmul can work for me.