KFrank:

Because you calculate Softmax(), the last dimension of att will
sum to one, up to floating-point round-off error.


So I need to control it before bceloss, is it right? Such as
score[score > 1.0] = 1.0