Optimization, Randomness, Decision Making, Analogy, Mathematical Modeling.
interaction effects of infinite large feature space for infinite many target variables, doing counter-intuitive things or random steps might lead to better local optima. The system is just too complex for even the best intuition and therefore applying only gradient descent methods is not