Not all operations are deterministic even is all seeds are properly set as described in the reproducibility docs.
The new torch.set_deterministic() call is currently in its beta stage, but would raise an error if such a non-deterministic operation is used in your script.