Hi,
The dataloader should be deterministic if the torch and torch.cuda seeds are fixed in your script.
Be careful as well that the computations of the net are not necessarily deterministic, in particular few cudnn operations are not. You will need to set torch.backends.cudnn.deterministic=True but this will have a noticeable impact on speed.