Solved by ptrblck in post #2 
              
              
                Your current implementation misses the relu as well as adaptive pooling layer from the DenseNet implementation as used here, which would create a tensor of [batch_size, 1024, 7, 7] for the output of self.densenet.features. 
Also, you might want to concatenate the activation tensors in dim1 (feature …