Firstly, it is not torch.add(A+B). It should be torch.add(A,B). As far as I know there is no difference between them. You said in some cases there are difference. can you state those cases, so that we can check.