Nice article.
I tried using fully connected layers to map embedding of queries, but the query has variable length other than the single word label which made it much more complicated and  having bad result.