Deep Learning, Image Processing, Convolutional Network, Machine Learning, Artificial Intelligence.
activation function. The use of sigmoid or softmax has been widely replaced in CNNs with ReLU, however even better option is available — SWISH. Swish remedies the discontinuity in the ReLU activation, significantly improving the gradient updates. Convergence The convergence of networks (iterations