Abstract Abstract: Techniques described herein relate to facilitating end-to-end multilingual communications with automated assistants. In various implementations, speech recognition output may be generated based on voice input in a first language. A first language intent may be identified based on the speech recognition output and fulfilled in order to generate a first natural language output candidate in the first language. At least part of the speech recognition output may be translated to a second language to generate an at least partial translation, which may then be used to identify a second language intent that is fulfilled to generate a second natural language output candidate in the second language. Scores may be determined for the first and second natural language output candidates, and based on the scores, a natural language output may be selected for presentation. WO 2019/172946 PCT/US2018/027774 CLIENT DEVICE CLIENT DEVICE f1 10fN MESSAGE EXCHANGE MESSAGE EXCHANGE CLIENT 10711 CLIENT 107N I AUTOMATED I AUTOMATED ASSISTANT CLIENT ASSISTANT CLIENT SPEECH CAPTURE/ SPEECH CAPTURE/ TTS/STT 1 1 4 1 TTS/STT 114N L ---- ---- ------- - CLOUD-BASED AUTOMATED ASSISTANT Fig. 1 COMPONENT(S) Fg 1119 116 13 11L I13 NATURAL NATURAL LANGUAGE LANGUAGE 127 PROCESSOR GENERATOR INTENT MATCHER 136 137 FULFILLMENT ENGINE 124 SEARCH5ENGINE TRANSLATOR SCORING ENGINE C13 9 138 140. T ----------
FACILITATING END-TO-END COMMUNICATIONS WITH AUTOMATED ASSISTANTS IN MULTIPLE LANGUAGES