Explained, Deep Learning, Hyperparameter, AI, Backpropagation.
Functions like ReLU, Sigmoid, Tanh, etc., that determine the output of a neural network node given an input or set of inputs. Optimizer: Algorithms like Adam, SGD (Stochastic Gradient Descent), etc., are used to update weights in the training phase. We will discuss more on Optimizers in a separate