Mathematics, Optimization, Data Science, Machine Learning, Duality.
gradient descent, to quadratic programming in SVM, to expectation-maximization algorithm in Gaussian mixture models. However, one aspect of optimization that always puzzled me is duality: what on earth is a primal form and dual form of an optimization problem, and what good do they really serve?