Answer:
After a few try-and-hit methods I find a solution that is very simple to map the weights of the state_dic.
Which is in the form of strict=False.
device = torch.device("cuda:0" if torch.cuda.is_available() else "cpu")


# device = torch.device("cpu")
model = rps.models.get_classifier(models.densenet121, 14).to(device) 
# I want to train the model on 10 classes where when I try to mentioned 10 it get error due to `state_dic`.
model.load_state_dict(torch.load('/home/ali/models/classifier_densenet121.pth'), , strict=False )

Thanks