features [ 12] are extracted from the last feature map of \res5" using RoIAlign [ 15].
Our choice for this architecture is motivated by the fact that it is simple and has
achieved state-of-the-art results on the AVA dataset [ 14] in a fully-supervised
setting [ 9]. Note that our network does not use additional optical 
ow inputs
(which can be considered as an additional source of supervision) as common in
other video architectures [5,19,41,6].
We predict the uncertainty, 2RCfor each of the Cbinary labels dened
by the dataset for each tubelet. As we use max-pooling to aggregate the tubelet
predictions, we select the uncertainty prediction corresponding to the selected
tubelet for computing the loss. For numerical stability, we predict v:=log2
with our network, using the \softplus", f(x) =log(1 + exp(x)), activation
function to ensure positivity. We then compute1
2=exp(v), and avoid the
possibility of dividing by 0 which could be the case if we predicted 2directly
with the network.
We train our network with synchronous stochastic gradient descent (SGD),
using 8 GPUs and a batch size of 4 on each GPU. In our case, each element of a
Despite the recent advances in video classification, progress in
spatio-temporal action recognition has lagged behind. A major contributing
factor has been the prohibitive cost of annotating videos frame-by-frame. In
this paper, we present a spatio-temporal action recognition model that is
trained with only video-level labels, which are significantly easier to
annotate. Our method leverages per-frame person detectors which have been
trained on large image datasets within a Multiple Instance Learning framework.
We show how we can apply our method in cases where the standard Multiple
Instance Learning assumption, that each bag contains at least one instance with
the specified label, is invalid using a novel probabilistic variant of MIL
where we estimate the uncertainty of each prediction. Furthermore, we report
the first weakly-supervised results on the AVA dataset and state-of-the-art
results among weakly-supervised methods on UCF101-24.
Anurag Arnab Chen Sun Arsha Nagrani Cordelia Schmid