key is computed as their dot product between scaled by √
𝑑𝑘. To obtain the weights on values, the
scaled dot product values are passed through a softmax function:
AReviewofDeepLearningTechniquesforSpeechProcessing