[1]王策,姬晓飞,李一波.一种简便的视角无关动作识别方法[J].智能系统学报,2014,9(5):577-583.[doi:10.3969/j.issn.1673-4785.201307057]
WANG Ce,JI Xiaofei,LI Yibo.Study on a simple view-invariant action recognition method[J].CAAI Transactions on Intelligent Systems,2014,9(5):577-583.[doi:10.3969/j.issn.1673-4785.201307057]
点击复制
WANG Ce,JI Xiaofei,LI Yibo.Study on a simple view-invariant action recognition method[J].CAAI Transactions on Intelligent Systems,2014,9(5):577-583.[doi:10.3969/j.issn.1673-4785.201307057]
一种简便的视角无关动作识别方法
《智能系统学报》[ISSN 1673-4785/CN 23-1538/TP] 卷:
9
期数:
2014年第5期
页码:
577-583
栏目:
学术论文—机器学习
出版日期:
2014-10-25
- Title:
- Study on a simple view-invariant action recognition method
- Keywords:
- action recognition; view-invariant; view-space partitioning; interest points; optical flow; mixed feature; hidden Markov model; likelihood probability weighted fusion
- 分类号:
- TP391.4
- 摘要:
- 针对日常生活中人体执行动作时存在视角变化而导致难以识别的问题,提出一种基于视角空间切分的多视角空间隐马尔可夫模型(HMM)概率融合的视角无关动作识别算法。该方法首先按照人体相对于摄像机的旋转方向将视角空间分割为多个子空间,然后选取兴趣点视频段词袋特征与分区域的光流特征相融合,形成具有一定视角鲁棒性特征对人体运动信息进行描述,并在每个子视角空间下利用HMM建立各人体动作的模型,最终通过将多视角空间相应的动作模型似然概率加权融合,实现对未知视角动作的识别。利用多视角IXMAS动作识别数据库对该算法进行测试的实验结果表明,该算法实现简单且对未知视角下的动作具有较好识别结果。
- Abstract:
- It is difficult to recognize the human actions under view changes in daily living. In order to solve this problem, a novel multi-view space hidden Markov model algorithm for view-invariant action recognition based on view space partitioning is proposed in this paper. First, the whole view space is partitioned into multiple sub-view spaces according to the rotation direction of a person relative to camera. Next, a view-robust feature representation by combination of the bag of interest point words in shot length-based video and amplitude histogram of local optical flow is utilized for describing the information of human actions. Thereafter, the human action models in each sub-view space are trained by HMM algorithm. Finally, the unknown view action is recognized via the likelihood probability weighted fusion of the corresponding action models in multi-view space. The experimental results on multi-view action recognition dataset IXMAS demonstrated that the proposed approach is easy to implement and has satisfactory performance for the unknown view action recognition.
- 参考文献/References:
-
[1] WEINLAND D, RONFARD R, BOYER E. A survey of vision-based methods for action representation, segmentation, and recognition [J]. Computer Vision and Image Understanding, 2011, 115(2):224-241
[2] SEO H, MILANFAR P. Action recognition from one example[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(5):867-882.
[3] JI X, LIU H. Advances in view-invariant human motion analysis:a review[J]. IEEE Transactions on Systems, Man and Cybernetics, Part C, 2010, 40(1):13-24.
[4] JUNEJO I, DEXTER E, LAPTEV I. Action recognition from temporal self-similarities[C]//Proceeding of the 10th European Conference on Computer Vision. Marseille, France, 2008:293-306.
[5] LYU F, NEVATIA R. Recognition and segmentation of 3-D human action using HMM and multi-class AdaBoost[C]//Proceeding of the 9th European Conference Computer Vision, Graz, 2006:359-372
[6] YU S, TAN D, TAN T. Modelling the effect of view angle variation on appearance-based gait recognition[C]//Proceeding of the 8th Asian Conference Computer Vision. Hyderabad, 2006:807-816.
[7] WEINLAND D, RONFARD R, BOYER E. Free viewpoint action recognition using motion history volumes[J]. Computer Vision and Image Understanding, 2006, 104(2):249-257.
[8] PEURSUM P, VENKATESH S, WEST G. Tracking as recognition for articulated full body human motion analysis[C]//Proceeding of the 25th IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis, USA, 2007:1-8.
[9] LYU F, NEVATIA R. Single view human action recognition using key pose matching and Viterbi path searching//Proceeding of the 25th IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis, USA, 2007:1-8.
[10] DOLLAR P, RABAUD V, COTTRELL G, et al. Behavior recognition via sparse spatio-temporal features[C]//Proceeding of IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance. 2005:65-72.
[11] SONG Y, TANG S. A distribution based video representation for human action recognition[C]//Proceeding of the IEEE International Conference on Multimedia and Expo. Suntec, Singapore, 2010:772-777.
[12] REN H, THOMAS B. Action recognition using salient neighboring histograms[C]//Proceeding of the 20th IEEE International Conference on Image Processing. Melbourne, Australia, 2013:2807-2811.
[13] BREGOMZIO M, GONG S, XIANG T. Recognizing action as clouds of space-time interest points[C]//Proceeding of the 27th IEEE Conference on Computer Vision and Pattern Recognition. Miami, USA, 2009:1948-1955.
[14] SCOVANNER P, ALI S, SHAH M. A 3-dimensional sift descriptor and its application to action recognition[C]//Proceeding of the 15th International Conference on Multimedia. Augsburg, Germany, 2007:357-360.
[15] 姬晓飞, 王策, 李一波. 一种基于视角鲁棒性特征的人体动作识别方法研究[C]//第32届中国控制会议论文集. 西安, 中国, 2013:3877-3881.JI Xiaofei, WANG Ce, LI Yibo. An action recognition method based on view-insensitive feature representation[C]//Proceeding of the 32th Chinese Control Conference. Xi’an, China, 2013:3877-3881.
[16] TRAN D, SOROKIN A. Human activity recognition with metric learning[C]//Proceeding of the 10th European Conference on Computer Vision. Marseille, France, 2008:548-561.
[17] JUNEJO I, DEXTER E, LAPTEV I, et al. Cross-view action recognition from temporal self-similarities[C]//Proceeding of the 10th European Conference on Computer Vision. Marseille, France, 2008:293-306.
[18] WEINLAND D, OZUYSAL M, FUA P. Making action recognition robust to occlusions and viewpoint changes[C]//Proceeding of the 11th European Conference on Computer Vision. Heraklion, Greece, 2010:635-648.
[19] LIU J, SHAH M, KUIPERS B, et al. Cross-view action recognition via view knowledge transfer[C]//Proceeding of the 29th IEEE Conference on Computer Vision and Pattern Recognition. Colorado, USA, 2011:3209-3216.
[20] JIANG Z, ZHE L, LARRY D. Recognizing human actions by learning and matching shape-motion prototype trees[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(3):533-547.
- 相似文献/References:
-
[1]张元元,吴晓娟,李秀媛,等.平行线约束下的视角无关步态识别算法[J].智能系统学报,2009,4(3):264.
ZHANG Yuan-yuan,WU Xiao-juan,LI Xiu-yuan,et al.Viewpointindependent gait recognition with parallel line constraints[J].CAAI Transactions on Intelligent Systems,2009,4():264.
[2]庄伟源,成运,林贤明,等.关键肢体角度直方图的行为识别[J].智能系统学报,2015,10(1):20.[doi:10.3969/j.issn.1673-4785.201410039]
ZHUANG Weiyuan,CHENG Yun,LIN Xianming,et al.Action recognition based on the angle histogram of key parts[J].CAAI Transactions on Intelligent Systems,2015,10():20.[doi:10.3969/j.issn.1673-4785.201410039]
[3]姬晓飞,王昌汇,王扬扬.分层结构的双人交互行为识别方法[J].智能系统学报,2015,10(6):893.[doi:10.11992/tis.201505006]
JI Xiaofei,WANG Changhui,WANG Yangyang.Human interaction behavior-recognition method based on hierarchical structure[J].CAAI Transactions on Intelligent Systems,2015,10():893.[doi:10.11992/tis.201505006]
[4]莫凌飞,蒋红亮,李煊鹏.基于深度学习的视频预测研究综述[J].智能系统学报,2018,13(1):85.[doi:10.11992/tis.201707032]
MO Lingfei,JIANG Hongliang,LI Xuanpeng.Review of deep learning-based video prediction[J].CAAI Transactions on Intelligent Systems,2018,13():85.[doi:10.11992/tis.201707032]
[5]钟秋波,郑彩明,朴松昊.时空域融合的骨架动作识别与交互研究[J].智能系统学报,2020,15(3):601.[doi:10.11992/tis.202006029]
ZHONG Qiubo,ZHENG Caiming,PIAO Songhao.Research on skeleton-based action recognition with spatiotemporal fusion and human–robot interaction[J].CAAI Transactions on Intelligent Systems,2020,15():601.[doi:10.11992/tis.202006029]
备注/Memo
收稿日期:2013-07-30。
基金项目:国家自然科学基金资助项目(61103123).
作者简介:王策, 男, 1989年生, 硕士研究生, 主要研究方向为基于视频的人体运动建模及其分析;李一波, 男, 1963年生, 教授, 博士生导师, 博士, 主要研究方向为生物特征识别、图像处理与模式识别、飞行控制、复杂系统、人工智能等。曾获军队级科技进步3等奖1项、省国防工业办公室科技进步2等奖1项。主持和参与近30项科研项目, 发表学术论文100余篇, 其中被SCI及EI检索30余篇。
通讯作者:姬晓飞, 女, 1978年生, 副教授, 博士, 主要研究方向为视频分析与处理、模式识别。承担国家自然科学基金项目、教育部留学回国启动基金项目等多项基金研究工作。发表学术论文30余篇, 其中被SCI、EI检索15篇。参与编著英文专著1部。E-mail:jixiaofei7804@126.com.
更新日期/Last Update:
1900-01-01