Solved by ptrblck in post #2 
              
              
                Based on the weight shape I guess the error is raised by an nn.Conv3d layer. Could you check where such a layer is used in this config and make sure the input to it has 3 valid channels?