Hi,
If you have a linear of size 768 -> 1 than the weights matrix will be of size 768
But if you have a bilinear from 768x768 -> 1, then the weight matrix will be 768 * 768 which is much bigger.
And so, depending on the batch size, it will consume a lot more memory.