A multimodal machine learning-based translation method, related to the technical field of artificial intelligence. Source sentences of n modes are semantically associated; a semantic association diagram is constructed; in the semantic association diagram, a first connecting edge is employed to connect semantic nodes of a same mode, and a second connecting edge is employed to connect semantic nodes of different modes. Semantic associations between the multimodal source sentences are fully expressed by the semantic association diagram, then, full semantic fusion is performed with respect to eigenvectors in the semantic association diagram to produce encoded eigenvectors, and target sentences of increased accuracy are produced when the encoded eigenvectors are decoded, the target sentences being brought closer to the multimodal source sentences in terms of the content, emotion, and language environment comprehensively expressed thereby.
MULTIMODAL MACHINE LEARNING-BASED TRANSLATION METHOD, DEVICE, EQUIPMENT, AND STORAGE MEDIUM