Dear community,
if I create my batch collection of a data set using
batches = torch.utils.data.DataLoader(train_set, batch_size=bs, shuffle=True)
will any data point appear in exactly one batch? I.e. is the sum of batches equal to my entire data set?
Or is each batch independently sampled from the entire data set, and it can happen that there are data points that don’t belong to a batch or that the same data point happens to be in different batches?
Also, if I do this:
    for epoch in range(epochs):
        for (batchidx, (features, targets)) in enumerate(batches_train):
            output = serial_net.forward(features)

Will the order of batches that is fed into the network be equal for each epoch?
Best,
PiF