The output is most likely just rounded due to the default print options.
If you want to have more precision, you could use torch.set_printoptions 2.
Anyway, I would expect that different frameworks might diverge after a while just because of the limited floating point precision and a possibly different operation order.
However, it’s still concerning that your Caffe model converges to a better final state than your PyTorch model.