So I found out some of my data was 640x640 and have padded those images to 640x800. Now that all my data is of the same length I’ve retried the code:
X = torch.Tensor([i[0] for i in data])
which I now get an error of:
TypeError: only size-1 arrays can be converted to Python scalars
edit:
I am able to make a list of tensors of the data with:
    # X = []
    # for i in data:
    #     t = torch.Tensor(i[0])
    #     X.append(t)

however I think it is true that you need to feed the model a single tensor so I have to convert the list of tensors to a tensor of tensors?