Deterministic results are not guaranteed between different hardware releases.
To get the same initialization, you could initialize the model on one device, save the state_dict, and load it on the other.