If you want to use a CNN, on your first Conv2d layer you could pass (in_channels=4, …).
For this particular error you are facing, can you provide the values of the following?
output.shape
labels.shape