The invention discloses a visual relationship segmentation method taking human as the main body. The method comprises the steps of firstly extracting the object instance segmentation from an input image, separating a common object from a human body, and extracting a face detection result from the input image; combining the human body segmentation extracted from the object instance segmentation with the face detection result to obtain a more perfect detection segmentation result, and taking the object segmentation and the improved human body segmentation as the image segmentation of an object and a subject respectively and inputting into a prediction network to obtain a (subject-predicate-object) visual relationship triple taking the human as the subject, and screening the results accordingto the language prior statistics. The segmentation positioning result and the relation triad generated by the method have better accuracy, and support can be provided for image search, image description and image questions and answers.
Visual relationship segmentation method taking human as main body