OK, I made a big mistake. The model forward process is out the for-loop, so the loss always be calculated by the same output1 and output2.
When I add the output1, output2 = s_bert(tokenized_input1, tokenized_input2) into the loop, it does work.