I added strict=False:
     cnn.load_state_dict(new_state_dict, strict=False)

And got this error message:
    cnn.load_state_dict(new_state_dict, strict=False)
  File "/usr/local/lib/python2.7/dist-packages/torch/nn/modules/module.py", line 519, in load_state_dict
    .format(name, own_state[name].size(), param.size()))
RuntimeError: While copying the parameter named features.4.weight, whose dimensions in the model are torch.Size([96, 96, 1, 1]) and whose dimensions in the checkpoint are torch.Size([256, 256, 1, 1]).

So I think that I may have messed up in with the layer order somehow.