Evolutionary optimization is a methodology for the global optimization of noisy black-box functions. In hyperparameter optimization, evolutionary optimization uses evolutionary algorithms to search the space of hyperparameters for a given algorithm.[1] Evolutionary hyperparameter optimization follows a process inspired by the biological concept of evolution: