When using nn. Transformer the size of

d_model

must be divvided by

nhead


What is the reason for this restriction ?
Is the reason is a parallel work ? [The sequence will be split along the emb_dim dimension ?]