Might be a while before I can get the tensor sizes via PDB. I did check the grad sizes after back prop. The Bilinear layer weight.data was of the shape 5x5x5 while the weight.grad was of the shape 5x5. The shape of the bias and it’s gradient was consistent