Ok, but if the you have specific parameters, and the input data $x$ is the same, then the gradients of these different models will also be the same, right? By training the models using different datasets the models will have different parameters, but since you want same specific parameters values, then the gradients will be the same.