Hi,
Why do you expect the gradient to be symmetric?
If I get a matrix, and pass it through a function that only takes the first row and sum it. The gradient will be 1s in the first row. Whether the input matrix is symmetric or not does not influence that.