RoySadaka:

Adding more heads will add more parameters.


This part in not correct I think, embed_dim is split into num_heads groups. So, parameter shapes are the same, but these groups are processed independently using reshaping (source 9).