Table 3: Results of semantic boundary labeling on the SBD benchmark using the Max F-score (MF) and Average Precision
(AP) metrics. Our method (H FL) outperforms Inverse Detectors [11] for all 20categories according to both metrics. Note
that using the CRF output to label the boundaries produces better results than using the outputs from the FC8 layer of FCN.
evaluated using the maximum F-score (MF), and average
precision (AP) measures.
Labeling boundaries with the semantic object information is a novel and still relatively unexplored problem.
Therefore, we found only one other approach (Inverse Detectors) that tried to tackle this problem [11]. The basic idea behind Inverse Detectors consists of several steps.
First, generic boundaries in the image are detected. Then,
a number of object proposal boxes are generated. These
two sources of information are then used to construct the
features. Finally, a separate classiﬁer is used to label the
boundaries with the object-speciﬁc information.
Table 3 shows that our approach signiﬁcantly outperforms Inverse Detectors according to both the maximum Fscore and the average precision metrics for all twenty categories. As described in Section 4.1 we evaluate the two
Most of the current boundary detection systems rely exclusively on low-level
features, such as color and texture. However, perception studies suggest that
humans employ object-level reasoning when judging if a particular pixel is a
boundary. Inspired by this observation, in this work we show how to predict
boundaries by exploiting object-level features from a pretrained
object-classification network. Our method can be viewed as a "High-for-Low"
approach where high-level object features inform the low-level boundary
detection process. Our model achieves state-of-the-art performance on an
established boundary detection benchmark and it is efficient to run.
  Additionally, we show that due to the semantic nature of our boundaries we
can use them to aid a number of high-level vision tasks. We demonstrate that
using our boundaries we improve the performance of state-of-the-art methods on
the problems of semantic boundary labeling, semantic segmentation and object
proposal generation. We can view this process as a "Low-for-High" scheme, where
low-level boundaries aid high-level vision tasks.
  Thus, our contributions include a boundary detection system that is accurate,
efficient, generalizes well to multiple datasets, and is also shown to improve
existing state-of-the-art high-level vision methods on three distinct tasks.
Gedas Bertasius Jianbo Shi Lorenzo Torresani