So, are you using some pre-trained models? If so, then yes, it depends how those models are trained. They could have been trained by different groups and therefore, their initialization might be different.