So the shape of the input is [2048, 10, 6, 1] even if I convert the memory format like this:
 for j, data in enumerate(trainloader, 0):
        inputs, labels = data
        inputs = inputs.to(memory_format=torch.channels_last)
        print("\ninput: ", inputs.shape)