The invention relates to an image description generation method and device based on a scene graph, and the method comprises the steps: inputting a to-be-processed image into a scene graph generation network, and obtaining a visual feature vector of each target object in the to-be-processed image and a relation type probability distribution vector between the target objects; performing weight prediction processing on the relationship category probability distribution vector to obtain a relationship weight vector between the target objects; performing context coding processing on the relationship weight vector and the visual feature vector to obtain an object feature vector of each target object; and performing language decoding processing on the object feature vector to obtain description information of the to-be-processed image. According to the image description generation method based on the scene graph, the scene graph can be used as intermediate representation, the content in one picture can be described in a more organized and structured mode, and therefore more accurate and richer image description can be generated.
Image description generation method and device based on scene graph