<i>Linear models struggle with this. In a linear model, mostly, each word is an island.</i><p>It&#x27;s actually quite easy to do this with a linear model. You use the distribution of head&#x2F;relation&#x2F;dependent pairs as an auxiliary distribution in a linear model. This has been done for quite some time (see my answer to your parent).<p>This auxiliary distribution is then estimated using machine-annotated data. Of course, a non-linear classifier using embeddings is cheaper to train ;), because you don&#x27;t have to parse a lot of data ahead of time.