Mathematics, Mathematics Education, Machine Learning, Data Science.
is symmetric, the eigenvectors are orthogonal to each other, hence the matrix P is also orthogonal. Going back to expression (18), (20) As the covariance matrix of our datapoints is also a real symmetric matrix, it is diagonalizable. Here λ is a diagonal matrix. The covariance matrix K_XX is