Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
mini-batch size of m<2000 For a larger training set, typical mini-batch sizes are: 64, 128, 256, 512 Make sure that the mini-batch size fits your CPU/GPU memory Exponentially weighted averages Below is a sample of hypothetical temperature data collected for an entire year: Θ1 = 40 F Θ2 = 49 F Θ3 =