By disclosing a method, device, electronic device, and storage medium for processing a semantic representation model, the present invention relates to an artificial intelligence technology. The specific implementation plan comprises the steps of: collecting a training corpus comprising a plurality of training language materials; and performing training on the semantic representation model based on at least one of morphology, grammar, and semantic using the training corpus. In the present invention, by constructing an unsupervised or a weak supervised pre-training task at these three different levels of morphology, grammar, and semantics, the present invention is capable of strengthening an ability of a general-purpose semantic expression and improving a processing effect of an NLP task by allowing the semantic representation model to learn different classes of knowledge such as vocabulary, grammar, and semantic among large-scale data.
SEMANTIC REPRESENTATION MODEL PROCESSING METHOD DEVICE ELECTRONIC EQUIPMENT AND STORAGE MEDIUM