You can use torch.random.get_rng_state() and torch.random.set_rng_state(prev_state). See torch.random — PyTorch 1.7.0 documentation 30 for docs.
Another option is to use NumPy to generate your random fixed tensor.
np.random.seed(0)
random_fixed_tensor = torch.as_tensor(np.random.normal(...))