Thanks for the update! Could you check, if updating to the nightly release would change the behavior or raise an error after setting use_deterministic_algorithms(True)?
If that’s not the case, could you run a debugging step of using predefined tensors (store the tensors locally and just load them or use e.g. torch.full(size, loop_index)) and compare the outputs again?