Citation

Liu C, Ying J, Yang H, Hu X, Liu J. Vis. Comput. 2021; 37(6): 1327-1341.

Copyright

(Copyright © 2021, Computer Graphics Society, Publisher Holtzbrinck Springer Nature Publishing Group)

DOI

10.1007/s00371-020-01868-8

PMID

unavailable

Abstract

In order to improve the accuracy of human abnormal behavior recognition, a two-stream convolution neural network model was proposed. This model includes two main parts, VMHI and FRGB. Firstly, the motion history images are extracted and input into VGG-16 convolutional neural network for training. Then, the RGB image is input into Faster R-CNN algorithm for training using Kalman filter-assisted data annotation. Finally, the two stream VMHI and FRGB results are fused. The algorithm can recognize not only single person behavior, but also two person interaction behavior and improve the recognition accuracy of similar actions. Experimental results on KTH, Weizmann, UT-interaction, and TenthLab dataset showed that the proposed algorithm has higher accuracy than the other literature.

Language: en