Data Science, Machine Learning, Deep Learning, Neural Networks, Activation Functions.
its non-convex nature. The graph of the sigmoid function looks like an ‘S’ because it has an up and down hill in its shape. The up and down hills of the graph are what create the ‘S’ shape. This non-convex nature makes it so that the points on the graph tend to bend towards the linear line, which