Assuming the returned tensor contains the desired values, you could flatten it in the DataLoader loop via:

for batch in dls:
    sample = batch['sample']
    sample = sample.view(-1, 5)
    print(sample.shape) # should print [4, 5] now

Using a custom collate_fn would probably also work, but I think the view operation might be easier.