Optimization, Linear Programming, Convex Optimization, Duality, Towards Data Science.
for optimality in linear programming. Necessary and sufficient for optimality in convex optimization, such as least square minimization in linear regression. Necessary for optimality in non-convex optimization problem, such as deep learning model training. KKT Conditions for Linear Program with