Hello! I look up the docs and can not find what attention function used in torch.nn.MultiheadAttention: MultiheadAttention — PyTorch 1.7.0 documentation 13
What’s more, I don’t know how to custom my attention function.