Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
competitions and hackathons. But how important is it in the overall scheme of things? Tuning these hyperparameters effectively can lead to a massive improvement in your position on the leaderboard. Following are a few common hyperparameters we frequently work with in a deep neural network: Learning