Machine Learning, Artificial Intelligence, Neural Networks, Data Science, Towards Data Science.
opposed to time averaging). Using the weights from snapshots and then averaging these weights for an ensemble prediction (a hybrid approach of ensemble and time averaging). Polyak averaging guarantees strong converge in a convex setting. However, in non-convex surfaces (which is typically the case)