Neural Networks, Deep Learning, Data Science, Algorithmic Trading, Cryptocurrency Investment.
LSTM units. It masks the connections between time steps to prevent the model from memorizing the sequence too perfectly. Why NO ReLU Activation in LSTM Layers: ReLU (Rectified Linear Unit) activation is not commonly used in LSTM layers because it tends to suffer from the vanishing gradient problem,