Forgive me, but I don’t understand what broadcasting means in this context.
The sizes are [4600 , 400] for both matrices (I think I may have made a mistake by calling them Tensors), and the output is the same size.
(Worth noting, is that the network runs for a couple seconds before giving the memory error.)