Transformers, Artificial Intelligence, Machine Learning, Large Language Models, Technology.
The softmax is statistical function for converting a vector of numerical values into a probability distribution. The values outputted by the softmax function are in the range (0, 1) and sum up to 1, making them ideal for representing probabilities. Image by author Let’s apply the softmax in the