I understand want you mean,the weight matrix can be broadcasted.
But in the pytorch code I always see torch.mm(A,B)(or bmm for batch) Instead of AB, and I’m wondering if I use AB, can my network backpropagation right(with Autograd)?