HMM Based Action Recognition with Projection Histogram Features

Vezzani R., Baltieri D., Cucchiara R.

20th International Conference on Pattern Recognition Conference, İstanbul, Turkey, 23 - 26 April 2010, vol.6388, pp.286-293 identifier

  • Publication Type: Conference Paper / Full Text
  • Volume: 6388
  • City: İstanbul
  • Country: Turkey
  • Page Numbers: pp.286-293
  • Istanbul Technical University Affiliated: No


Hidden Markov Models (HMM) have been widely used for action recognition, since they allow to easily model the temporal evolution of a single or a set of numeric features extracted from the data. The selection of the feature set and the related emission probability function are the key issues to be defined. In particular, if the training set is not sufficiently large, a manual or automatic feature selection and reduction is mandatory. In this paper we propose to model the emission probability function as a Mixture of Gaussian and the feature set is obtained from the projection histograms of the foreground mask. The projection histograms contain the number of moving pixel for each row and for each column of the frame and they provide sufficient information to infer the instantaneous posture of the person. Then, the HMM framework recovers the temporal evolution of the postures recognizing in such a manner the global action. The proposed method have been successfully tested on the UT-Tower and on the Weizmann Datasets.