I encountered a similar problem. In zero-shot learning condition, the embedding of sentence looks good when they have similar length, but when using embedding of query which is really short, the embedding is much worse. The embedding  of query is much closer to  the short rubbish data other than the long relative data. Still looking for good and simple training task to solve the problem.