We need to use both the random seed expressions:
random.seed(seed) 
torch.manual_seed(seed)

For details: The random seed for torchvision transforms is not fixed in PyTorch 1.6 · Issue #42331 · pytorch/pytorch · GitHub 2