Hi @afshin67,
If I understand your question corectly, a possible solution is to create a CustomDataset that returns a tuple with label and data or a dictionary containing both, a common approach that is shown in this tutorial 1. A small example I crafted in case you find it useful:
class CustomDataset(Dataset):

    def __init__(self, a, b):
    	self.a = a
    	self.b = b

    def __len__(self):
        return len(self.a)

    def __getitem__(self, idx):
    	return self.a[idx], self.b[idx]
        # return {"a": self.a[idx], "b": self.b[idx]}

train_data = CustomDataset(a, b)
data = torch.utils.data.DataLoader(train_data, 5, shuffle=True)

Hope it helps!