class newmodel(nn.Module):
    __init__():
    super(...)
    self.model_as_layer = model_constructor(*args,**kwargs)
    self.model_as_layer.load_state_dict(pretrained_weights)

Just loads weighs while you instantiate your layer