Hello. This may be a bit of an elementary question, but I was having trouble figuring out the nuts and bolts of things.
I’m currently trying to implement a neural network model, and in the original paper there is something about performing matrix multiplication with a layer-specific weight matrix.
Until now, when I perform that operation I used torch.nn.Linear, but I noticed that the code implementation used torch.nn.Parameter instead and performed matrix multiplication explicitly.
What is the difference between these two modules? I initially thought they were the same thing, but something’s telling me that’s not the case. Thanks.