input size of 220220, the network has limited capacity
to look at detail – it learns ﬁlters capturing pose properties
at coarse scale. These are necessary to estimate rough pose
but insufﬁcient to always precisely localize the body joints.
Note that we cannot easily increase the input size since this
will increase the already large number of parameters. In order to achieve better precision, we propose to train a cascade
of pose regressors. At the ﬁrst stage, the cascade starts off
by estimating an initial pose as outlined in the previous section. At subsequent stages, additional DNN regressors are
trained to predict a displacement of the joint locations from
previous stage to the true location. Thus, each subsequent
stage can be thought of as a reﬁnement of the currently predicted pose, as shown in Fig. 2.
Further, each subsequent stage uses the predicted joint
locations to focus on the relevant parts of the image – subimages are cropped around the predicted joint location from
previous stage and the pose displacement regressor for this
joint is applied on this sub-image. In this way, subsequent
pose regressors see higher resolution images and thus learn
features for ﬁner scales which ultimately leads to higher
precision.
We use the same network architecture for all stages of
the cascade but learn different network parameters. For
We propose a method for human pose estimation based on Deep Neural Networks
(DNNs). The pose estimation is formulated as a DNN-based regression problem
towards body joints. We present a cascade of such DNN regressors which results
in high precision pose estimates. The approach has the advantage of reasoning
about pose in a holistic fashion and has a simple but yet powerful formulation
which capitalizes on recent advances in Deep Learning. We present a detailed
empirical analysis with state-of-art or better performance on four academic
benchmarks of diverse real-world images.
Alexander Toshev Christian Szegedy