Hello,
Is there a way to tie the weights of certain parts of a (square) attention matrix?
For example if I divide the matrix in 4 blocks (2 diagonal and 2 off-diagonal) and want to tie the weights of the two off diagonal blocks how could I do that?
Thanks!