This paper presents an approach to simultaneously track the pose and recognize human actions in a video. This is achieved by combining Dynamic Bayesian Action Network (DBAN) with 2D body part models. Existing DBAN implementation relies on fairly weak observation features which affects recognition accuracy. In this work, we propose to use an occlusion sensitive 2D body part model for accurate pose alignment, which in turn improves both pose estimate and action recognition accuracy. To compensate for the additional time required for alignment, we use an action entropy based scheme to determine the minimum number of states to be maintained in each frame while avoiding sample impoverishment. We demonstrate our approach on a hand gesture dataset with 500 action sequences, and show that compared to DBAN, our algorithm achieves 6% improvement in accuracy.
['Vivek Kumar Singh', 'Ram Nevatia']
Human action recognition using a dynamic Bayesian action network with 2D part models