Thanks for the response. That’s what I was thinking but I hoped I was wrong. Related to the first question, do you know what defines the order of the state dict? If the last layer will be made up of the last tensors in the state dict then I might be able to get a “close enough” solution.