Deep Learning, Machine Learning, Artificail Intelligence, Neural Networks, Activation Functions.
- np.max(x)) return e_x / e_x.sum() values_of_x = [i*0.01 for i in range(-500,500)] plt.plot(scores ,softmax(values_of_x)) plt.xlabel("values of x") plt.ylabel("value of softmax") 4. Rectified Linear Unit Function The ReLU or Rectified Linear Activation Function is perhaps the most common function