It doesn’t really matter to me how the weight matrix gets updated. As long as it satisfies the constraint such that it also results in the lowest MSE loss. What do you mean the gradient is asymmetrical?