@albanD  I managed to to recreate the network and copy over all tensors by running through the keys and assigning them using some string parsing magic to
self.network.layers[firstindex][secondindex]

I do however still receive an error:
RuntimeError: the derivative for 'running_mean' is not implemented

which I looked up and I understand that these tensors don’t have to be wrapped by nn.Parameter().
However when I leave out the nn.Parameter() I get the following error:
RuntimeError: Error(s) in loading state_dict for Yolo:
        Unexpected key(s) in state_dict: "layers.0.1_convbatch.layers.1.running_mean", "layers.0.1_convbatch.layers.1.running_var", ...... 

How do I copy the running var and running mean tensors?