With repeat padding my attention even worse since where is now non zero data in padding.
                    
            
           1


Should you advise how to perform padding in query in multi head attention?
I tried to make mask, but got nan in softmax.