Machine Learning, Signal Processing, Bayesian Statistics, Editors Pick, Getting Started.
that the estimator and residual are perpendicular to each other. Source: http://fourier.eng.hmc.edu/e59/lectures/signalsystem/node9.html In the above figure X hat is an estimator of the X and X tilde is the residual. Mathematically this can be represented as follows: For example, applying the