Thanks for the answer. When i use self.model = nn.Sequential(*list(self.base_model.children())[:2], *list(self.base_model._blocks.children())[:num_blocks+2]) am I getting the weights as well? Seems like i should use deepcopy here, but I’m not pretty sure.