I tried but it for my dataset and network, but transfer learning works poorer as compare to random initalization of weights. So I thought, combining the nets along channel and performing convolution on combined will give more valuable features, I am also not sure of it …So I wanted to try this combining the network and training it for classification.