For the following input the error is generated in the above network at deconv5 at runtime.
    arr = np.random.randn(1, 64, 64, 64)
    input = Variable(torch.from_numpy(arr).float().unsqueeze(1).cuda())
    print(input.shape)
    net = ColorConv().cuda()
    output = net(input)
    print(output.shape)