You can see the non-determinism of the operations in the network as having the same effet as using a different weight initialization or a different shuffling of the dataloader !
It will give you completely different weights in the end but if your training is “stable”, the performance of the final network will be mostly similar.