Volume 8 Number 12 (Dec. 2013)
Home > Archive > 2013 > Volume 8 Number 12 (Dec. 2013) >
JCP 2013 Vol.8(12): 3093-3102 ISSN: 1796-203X
doi: 10.4304/jcp.8.12.3093-3102

Learning Discriminative Visual Codebook for Human Action Recognition

Qing Lei1, 2, 3, Shao-zi Li1, 2, Hong-bo Zhang1, 2
1Cognitive Science Department, Xiamen University, Xiamen, China
2Fujian Key Laboratory of the Brain-like Intelligent Systems, Xiamen, China
3College of Computer Science and Technology, HuaQiao University, Xiamen, China


Abstract—This paper explores how to improve BOW model for human action recognition in real environment. Traditional codebook learning uses single appearance based local features, thus spatial and temporal correlations of local features are ignored. This leads to a considerable amount of mismatch between sample vectors and noisy visual words resulted from background clutters. To improve the performance of BOW modeling in real settings, we propose a novel action modeling approach. First, two-level feature selection is applied in the pre-process phase of codebook learning to remove noisy features, thus descriptive and discriminative features are obtained. Then spatial-temporal pyramid matching (STPM) is employed in the feature coding process, in which we model human actions considering not only the appearance similarity between local features but also the spatial relationship of features in space and time. We validate our approach on several benchmark datasets and experimental results show that our approach significantly outperforms K-means clustering on more challenge datasets such as KTH, UCF sports and Youtube datasets.

Index Terms—BOW, human action recognition, codebook learning

[PDF]

Cite: Qing Lei, Shao-zi Li, Hong-bo Zhang, "Learning Discriminative Visual Codebook for Human Action Recognition," Journal of Computers vol. 8, no. 11, pp. 3093-3102, 2013.

General Information

ISSN: 1796-203X
Frequency: Monthly
Editor-in-Chief: Prof. Liansheng Tan
Executive Editor: Ms. Nina Lee
Abstracting/ Indexing: DBLP, EBSCO,  ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, CNKI,etc
E-mail: jcp@iap.org
  • Sep 13, 2018 News!

    Vol 13, No 10 has been published with online version   [Click]

  • Apr 28, 2019 News!

    Vol 14, No 4 has been published with online version 8 papers are published in this issue after peer review   [Click]

  • Mar 20, 2019 News!

    Vol 14, No 3 has been published with online version   [Click]

  • Feb 22, 2019 News!

    Vol 14, No 2 has been published with online version 8 papers are published in this issue after peer review   [Click]

  • Jan 04, 2019 News!

    Vol 14, No 1 has been published with online version   [Click]

  • Read more>>