Deep Learning, Machine Learning, Attention Mechanism, Time Series Analysis, Coding.
its original formula (Eq. 1) where only the part of the softmax function is important, not the rest. As long as we are concerned about the softmax as it is potent in the formula, for each query (qᵢ) we just focus on the key values (K) that are nearest to qᵢ. Locality sensitive hashing We use