across the 20 classes. According to this metric, the accuracy
is computed on a per pixel basis. As a result, the images that
contain large object regions are given more importance.
Figure 8: In this ﬁgure, the ﬁrst column depicts an input
image while the second and third columns illustrate two selected eigenvectors for that image. The eigenvectors contain
soft segmentation information. Because H FL boundaries
capture object-level boundaries, the resulting eigenvectors
primarily segment regions corresponding to the objects.
We observe that while DeepLab-CRF works well on the
images containing large object regions, it produces spatially
disjoint outputs for the images with smaller and object regions (see Figure 9). This issue is often being overlooked,
because according to the PP-IOU metric, the images with
large object regions are given more importance and thus
contribute more to the accuracy. However, certain applications may require accurate segmentation of small objects.
Therefore, in addition to PP-IOU, we also consider the PIIOU metric (pixel intersection-over-union averaged per image across the 20 classes), which gives equal weight to each
of the images.
For both of the metrics we compare the semantic segmentation results of a pure DeepLab-CRF [5] and also a
Most of the current boundary detection systems rely exclusively on low-level
features, such as color and texture. However, perception studies suggest that
humans employ object-level reasoning when judging if a particular pixel is a
boundary. Inspired by this observation, in this work we show how to predict
boundaries by exploiting object-level features from a pretrained
object-classification network. Our method can be viewed as a "High-for-Low"
approach where high-level object features inform the low-level boundary
detection process. Our model achieves state-of-the-art performance on an
established boundary detection benchmark and it is efficient to run.
  Additionally, we show that due to the semantic nature of our boundaries we
can use them to aid a number of high-level vision tasks. We demonstrate that
using our boundaries we improve the performance of state-of-the-art methods on
the problems of semantic boundary labeling, semantic segmentation and object
proposal generation. We can view this process as a "Low-for-High" scheme, where
low-level boundaries aid high-level vision tasks.
  Thus, our contributions include a boundary detection system that is accurate,
efficient, generalizes well to multiple datasets, and is also shown to improve
existing state-of-the-art high-level vision methods on three distinct tasks.
Gedas Bertasius Jianbo Shi Lorenzo Torresani