how do I check whether this formula will give better results, what would be the easiest way to do this?
Do I modify self attention in SEQUENCE-TO-SEQUENCE MODELING WITH NN.TRANSFORMER AND TORCHTEXT, this tutorial, or does any easier way to check performance of this formula exist?