of the pixels. We can then merge the two output maps as
follows. For a given boundary point we consider a 99
grid around that point from each of the 21FCN object-class
probability maps. We calculate the maximum value inside
each grid, and then label the boundary at a given pixel with
the object-class that corresponds to the maximum probability across these 21maps. We apply this procedure for each
of the boundary points, in order to associate object-class
labels to the boundaries. Note that we consider the grids
around the boundary pixel because the output of the FCN
has a poor localization, and considering the grids rather than
individual pixels leads to higher accuracy.
We can also merge H FL boundaries with the state-ofthe-art DeepLab-CRF segmentation [5] to obtain higher accuracy. We do this in a similar fashion as just described.
First, around a given boundary point we extract a 99
grid from the DeepLab-CRF segmentation. We then compute the mode value in the grid (excluding the background
class), and use the object-class corresponding to the mode
value as a label for the given boundary point. We do this for
each of the boundary points. By merging H FL boundaries
and the output of FCN or DeepLab-CRF, we get semantic
Most of the current boundary detection systems rely exclusively on low-level
features, such as color and texture. However, perception studies suggest that
humans employ object-level reasoning when judging if a particular pixel is a
boundary. Inspired by this observation, in this work we show how to predict
boundaries by exploiting object-level features from a pretrained
object-classification network. Our method can be viewed as a "High-for-Low"
approach where high-level object features inform the low-level boundary
detection process. Our model achieves state-of-the-art performance on an
established boundary detection benchmark and it is efficient to run.
  Additionally, we show that due to the semantic nature of our boundaries we
can use them to aid a number of high-level vision tasks. We demonstrate that
using our boundaries we improve the performance of state-of-the-art methods on
the problems of semantic boundary labeling, semantic segmentation and object
proposal generation. We can view this process as a "Low-for-High" scheme, where
low-level boundaries aid high-level vision tasks.
  Thus, our contributions include a boundary detection system that is accurate,
efficient, generalizes well to multiple datasets, and is also shown to improve
existing state-of-the-art high-level vision methods on three distinct tasks.
Gedas Bertasius Jianbo Shi Lorenzo Torresani