[1]宁欣,李卫军,田伟娟,等.一种自适应模板更新的判别式KCF跟踪方法[J].智能系统学报,2019,14(1):121-126.[doi:10.11992/tis.201806038]
　NING Xin,LI Weijun,TIAN Weijuan,et al.Adaptive template update of discriminant KCF for visual tracking[J].CAAI Transactions on Intelligent Systems,2019,14(1):121-126.[doi:10.11992/tis.201806038]
点击复制

一种自适应模板更新的判别式KCF跟踪方法

《智能系统学报》[ISSN 1673-4785/CN 23-1538/TP] 卷: 14 期数: 2019年第1期 页码: 121-126 栏目: 学术论文—机器学习 出版日期: 2019-01-05
Title:
Adaptive template update of discriminant KCF for visual tracking
作者:
宁欣1,2, 李卫军1,2,3, 田伟娟2, 徐驰2, 徐健1
1. 中国科学院半导体研究所 高速电路与神经网络实验室, 北京 100083;
2. 威富集团 形象认知计算联合实验室, 北京 100083;
3. 中国科学院大学 微电子学院, 北京 100029
Author(s):
NING Xin1,2, LI Weijun1,2,3, TIAN Weijuan2, XU Chi2, XU Jian1
1. Laboratory of Artificial Neural Networks and High-speed Circuits, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, China;
2. Image Cognitive Computing Joint Lab, Wave Group, Beijing 100083, China;
3. School of Microelectronics, University of Chinese Academy of Sciences, Beijing 100029, China
关键词:
目标跟踪; 目标检测; 高速核相关滤波算法; 模板更新; 卷积神经网络
Keywords:
visual tracking; object detection; high-speed kernelized correlation filters; template update; convolution neural network
分类号:
TP391
DOI:
10.11992/tis.201806038
摘要:
为了解决单目标跟踪算法中存在的目标旋转、遮挡和快速运动等挑战，提出了一种基于自适应更新策略的判别式核相关滤波器（kernelized correlation filter，KCF）目标跟踪新框架。构建了外观判别式模型，实现跟踪质量有效性的评估。构造了新的自适应模板更新策略，能够有效区分目标跟踪异常时当前目标是否发生了旋转。提出了一种结合目标检测的跟踪新构架，能够进一步有效判别快速运动和遮挡状态。同时，针对上述3种挑战，分别采用模板更新、目标运动位移最小化以及目标检测算法实现目标跟踪框的恢复，保证了跟踪的有效性和长期性。实验分别采用2种传统手动特征HOG和CN（color names）验证提出的框架鲁棒性，结果证明了提出的目标跟踪新方法在速度和精度方面的优越性能。
Abstract:
To solve the challenges of in-plane/out-of-plane rotation (IPR/OPR), fast motion (FM), and occlusion (OCC), a new robust visual tracking framework of discriminant kernelized correlation filter (KCF) based on adaptive template update strategy is presented in this paper. Specifically, the proposed discriminant models were first used to determine the tracking validity and then a new adaptive template update strategy was introduced to effectively distinguish whether or not the object has rotated when the object tracking was abnormal. Furthermore, a new visual tracking framework combining object test is presented, which could further effectively distinguish FM and OCC. Meanwhile, to overcome the above-mentioned challenges, three measures were taken to recover the object tracking frame:template updating, object movement displacement minimization, and use of an object detection algorithm ensuring validity and long-term visual tracking. We implemented two versions of the proposed tracker with representations from two conventional hand-actuated features, histogram of oriented gradient (HOG), and color names (CN) to validate the strong compatibility of the algorithm. Experimental results demonstrated the state-of-the-art performance in tracking accuracy and speed for processing the cases of IPR/OPR, FM, and OCC.
参考文献/References:
[1] YILMAZ A, JAVED O, SHAH M. Object tracking:a Survey[J]. ACM computing surveys, 2006, 38(4):45-50.
[2] CANNONS K. A review of visual tracking[R]. Technical Report CSE 2008-07. York University, Canada, 2008.
[3] HENRIQUES J F, CASEIRO R, MARTINS P, et al. High-speed tracking with kernelized correlation filters[J]. IEEE transactions on pattern analysis and machine intelli-gence, 2015, 37(3):583-596.
[4] DANELLJAN F M, KHAN F S, FELSBERG M, et al. Adaptive color attributes for real-time visual track-ing[C]//Proceedings of the 20014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus, USA, 2014:1090-1097.
[5] JIA Xu, LU Huchuan, YANG M H. Visual tracking via adaptive structural local sparse appearance mod-el[C]//Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, USA, 2012:1822-1829.
[6] KALAL Z, MIKOLAJCZYK K, MATAS J. Track-ing-learning-detection[J]. IEEE transactions on pattern analysis and machine intelligence, 2012, 34(7):1409-1422.
[7] KWON J, LEE K M. Visual tracking decomposi-tion[C]//Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco, USA, 2010:1269-1276.
[8] ROSS D A, LIM J, LIN R S, et al. Incremental learning for robust visual tracking[J]. International journal of computer vision, 2008, 77(1/2/3):125-141.
[9] HONG S, YOU T, KWAK S, et al. Online tracking by learning discriminative saliency map with convolutional neural network[C]//Proceedings of the 32nd International Conference on Machine Learning. Lille, France, 2015:597-606.
[10] MA Chao, HUANG Jiabin, YANG Xiaokang, et al. Hier-archical convolutional features for visual track-ing[C]//Proceedings of the 2015 IEEE International Con-ference on Computer Vision. Santiago, Chile, 2015:3074-3082.
[11] QI Yuankai, ZHANG Shengping, QIN Lei, et al. Hedged deep tracking[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, USA, 2016:4303-4311.
[12] WANG Lijun, OUYANG Wanli, WANG Xiaogang, et al. Visual tracking with fully convolutional net-works[C]//Proceedings of the 2015 IEEE International Conference on Computer Vision. Santiago, Chile, 2015:3119-3127.
[13] WANG Lijun, OUYANG Wanli, WANG Xiaogang, et al. Stct:sequentially training convolutional networks for visual tracking[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, USA, 2016:1373-1381.
[14] HARE S, SAFFARI A, TORR P H S. Struck:structured output tracking with kernels[C]//Proceedings of the 2011 International Conference on Computer Vision. Barcelona, Spain, 2011:263-270.
[15] NING Jifeng, YANG Jimei, JIANG Shaojie, et al. Object tracking via dual linear structured SVM and explicit feature map[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, USA, 2016:4266-4274.
[16] WANG Mengmeng, LIU Yong, HUANG Zeyi. Large margin object tracking with circulant feature maps[C]//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA, 2017:4800-4808.
[17] CHAN T H, JIA Kui, GAO Shenghua, et al. PCANet:a simple deep learning baseline for image classification?[J]. IEEE transactions on image processing, 2015, 24(12):5017-5032.
[18] WU Yi, LIM J, YANG M H. Online object tracking:a benchmark[C]//Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Portland, USA, 2013:2411-2418.
[19] KALAL Z, MIKOLAJCZYK K, MATAS J. Track-ing-learning-detection[J]. IEEE transactions on pattern analysis and machine intelligence, 2012, 34(7):1409-1422.
[20] WU Yi, SHEN Bin, LING Haibin. Online robust image alignment via iterative convex optimization[C]//Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition. Rhode Island, USA, 2012:1808-1814.
相似文献/References:
[1]王绍钰 蔡自兴,陈爱斌.改进的粒子滤波器目标跟踪方法[J].智能系统学报,2008,3(3):189.
　WANG Shao-yu,CAI Zi-xing,CHEN Ai-bin.Improved object tracking method for particle filters[J].CAAI Transactions on Intelligent Systems,2008,3():189.
[2]刘 清,吴志刚,窦 琴,等.粒子滤波的视频目标跟踪算法研究[J].智能系统学报,2009,4(6):538.[doi:10.3969/j.issn.1673-4785.2009.06.012]
　LIU Qing,WU Zhi-gang,DOU Qin,et al.A particle filtering algorithm for tracking moving objects in videos[J].CAAI Transactions on Intelligent Systems,2009,4():538.[doi:10.3969/j.issn.1673-4785.2009.06.012]
[3]伍 明,孙继银.一种机器人未知环境下动态目标跟踪交互多模滤波算法[J].智能系统学报,2010,5(2):127.
　WU Ming,SUN Ji-yin.An interacting multiple model filtering algorithm for mobile robots to improve tracking of moving objects in unknown environments[J].CAAI Transactions on Intelligent Systems,2010,5():127.
[4]李 金,胡文广.基于颜色的快速人体跟踪及遮挡处理[J].智能系统学报,2010,5(4):353.
　LI Jin,HU Wen-guang.Tracking fast movement using colors while accommodating occlusion[J].CAAI Transactions on Intelligent Systems,2010,5():353.
[5]刘侠,陶冶,邢春.统计差分与自启动的Camshift跟踪算法[J].智能系统学报,2011,6(4):355.
　LIU Xia,TAO Ye,XING Chun.An objective tracking Camshift algorithm based onautomatic startup and the statistical differential method[J].CAAI Transactions on Intelligent Systems,2011,6():355.
[6]胡光龙,秦世引.动态成像条件下基于SURF和Mean shift的运动目标高精度检测[J].智能系统学报,2012,7(1):61.
　HU Guanglong,QIN Shiyin.High precision detection of a mobile object under dynamic imaging based on SURF and Mean shift[J].CAAI Transactions on Intelligent Systems,2012,7():61.
[7]韩峥,刘华平,黄文炳,等.基于Kinect的机械臂目标抓取[J].智能系统学报,2013,8(2):149.[doi:10.3969/j.issn.1673-4785.201212038]
　HAN Zheng,LIU Huaping,HUANG Wenbing,et al.Kinect-based object grasping by manipulator[J].CAAI Transactions on Intelligent Systems,2013,8():149.[doi:10.3969/j.issn.1673-4785.201212038]
[8]伍明,孙继银.基于粒子滤波的未知环境下机器人同时定位、地图构建与目标跟踪[J].智能系统学报,2013,8(2):168.[doi:10.3969/j.issn.1673-4785.201202001]
　WU Ming,SUN Jiyin.Simultaneous localization, mapping and object tracking in an unknown environment using particle filtering[J].CAAI Transactions on Intelligent Systems,2013,8():168.[doi:10.3969/j.issn.1673-4785.201202001]
[9]贺超,刘华平,孙富春,等.采用Kinect的移动机器人目标跟踪与避障[J].智能系统学报,2013,8(5):426.[doi:10.3969/j.issn.1673-4785.201301028]
　HE Chao,LIU Huaping,SUN Fuchun,et al.Target tracking and obstacle avoidance of mobile robot using Kinect[J].CAAI Transactions on Intelligent Systems,2013,8():426.[doi:10.3969/j.issn.1673-4785.201301028]
[10]王熙,吴为,钱沄涛.基于轨迹聚类的超市顾客运动跟踪[J].智能系统学报,2015,10(2):187.[doi:10.3969/j.issn.1673-4785.201401002]
　WANG Xi,WU Wei,QIAN Yuntao.Trajectory clustering based customer movement tracking in a supermarket[J].CAAI Transactions on Intelligent Systems,2015,10():187.[doi:10.3969/j.issn.1673-4785.201401002]

备注/Memo

收稿日期:2018-06-22。
基金项目:国家自然科学基金项目（61572458）.
作者简介:宁欣,男,1989年生,博士,IEEE、中国计算机学会、中国人工智能学会、中国自动化学会会员,主要研究方向为计算机视觉、类脑视觉计算、形象认知计算和神经网络。发表学术论文15篇,被SCI收录5篇;李卫军,男,1975年生,教授,博士生导师,博士,主要研究方向为机器视觉、模式识别与智能系统、仿生图像处理技术、仿生模式识别理论与方法、近红外光谱定性分析技术、高维信息计算。主持国家自然科学基金项目2项,企业合作研究项目3项。发表学术论文30篇;田伟娟,女,1990年生,硕士研究生,主要研究方向为视频、图像处理和目标跟踪相关算法。
通讯作者:李卫军.E-mail:wjli@semi.ac.cn

更新日期/Last Update: 1900-01-01
Copyright © 《 智能系统学报》 编辑部
地址：（150001）黑龙江省哈尔滨市南岗区南通大街145-1号楼 电话：0451- 82534001、82518134　邮箱：tis@vip.sina.com