Training The network parameters 1are trained as
outlined in Sec. 3.1, Eq. (4). At subsequent stages
s2, the training is done identically with one important difference. Each joint ifrom a training example(x;y)is normalized using a different bounding box(y(s1)
i;diam(y(s1));diam(y(s1)))– the one centered at the prediction for the same joint obtained from previous stage – so that we condition the training of the stage
based on the model from previous stage.
Since deep learning methods have large capacity, we
augment the training data by using multiple normalizations
for each image and joint. Instead of using the prediction
from previous stage only, we generate simulated predictions. This is done by randomly displacing the ground truth
location for joint iby a vector sampled at random from a
2-dimensional Normal distribution N(s1)
i with mean and
variance equal to the mean and variance of the observed displacements (y(s1)
iyi)across all examples in the training data. The full augmented training data can be deﬁned
by ﬁrst sampling an example and a joint from the original
data at uniform and then generating a simulated prediction
We propose a method for human pose estimation based on Deep Neural Networks
(DNNs). The pose estimation is formulated as a DNN-based regression problem
towards body joints. We present a cascade of such DNN regressors which results
in high precision pose estimates. The approach has the advantage of reasoning
about pose in a holistic fashion and has a simple but yet powerful formulation
which capitalizes on recent advances in Deep Learning. We present a detailed
empirical analysis with state-of-art or better performance on four academic
benchmarks of diverse real-world images.
Alexander Toshev Christian Szegedy