interesting it seems it can’t even be done in 0.3.1?
(Pdb) net3.conv0.weight = net.conv0.weight + net2.conv0.weight
*** TypeError: cannot assign 'torch.autograd.variable.Variable' as parameter 'weight' (torch.nn.Parameter or None expected)