classication case, we use the binary cross-entropy:
Lce(x;y) =NbX
iCX
lyillogpil+ (1yil) log(1pil) (2)
Note that we dened pilas the bag-level probability of the ithbag taking the
lthlabel, which is obtained using Eq. 1, and Nbis the number of bags in the
mini-batch.
Uncertainty-Aware Weakly Supervised Action Detection 5
Aggregation The aggregation function, g(), can naturally be implemented in
neural networks as a global pooling function over all outputs of the network.
Common, permutation-invariant pooling functions include, max-pooling, generalised mean-pooling and log-sum-exponential (LSE) pooling [ 3] (a smooth and
convex approximation of the maximum function) respectively:
g(fpjg) = max
jpj (3)
g(fpjg) =0
@1
jjjX
jpr
j1
A1
r
(4)
g(fpjg) =1
rlog0
@1
jjjX
jerpj1
A (5)
Despite the recent advances in video classification, progress in
spatio-temporal action recognition has lagged behind. A major contributing
factor has been the prohibitive cost of annotating videos frame-by-frame. In
this paper, we present a spatio-temporal action recognition model that is
trained with only video-level labels, which are significantly easier to
annotate. Our method leverages per-frame person detectors which have been
trained on large image datasets within a Multiple Instance Learning framework.
We show how we can apply our method in cases where the standard Multiple
Instance Learning assumption, that each bag contains at least one instance with
the specified label, is invalid using a novel probabilistic variant of MIL
where we estimate the uncertainty of each prediction. Furthermore, we report
the first weakly-supervised results on the AVA dataset and state-of-the-art
results among weakly-supervised methods on UCF101-24.
Anurag Arnab Chen Sun Arsha Nagrani Cordelia Schmid