@chenchr I think it works. One can try model.fc4.load_state_dict(model.fc3.state_dict()) to updatefc4 layer’s parameters using the fc3 layer.
@fmassa, However not sure if clone() , state_dict() or deepcopy would be a better choice. It would be great if you can elaborate upon the differences!