KFrank:

is their a pre-packaged sampling-
with-replacement dataloader, or a simple strategy to write one?


RandomSampler 12 with replacement=True should probably do the job, if I understand your suggestion correctly.
Side note: the DataLoader creates this sampler by default, if shuffle=True is specified, but uses replacement=False.